title: Omnivision forecasting: combining satellite observations with sky images for improved intra-hour solar energy predictions

abstract: Integration of intermittent renewable energy sources into electric grids in large proportions is challenging. A well-established approach aimed at addressing this difficulty involves the anticipation of the upcoming energy supply variability to adapt the response of the grid. In solar energy, short-term changes in electricity production caused by occluding clouds can be predicted at different time scales from all-sky cameras (up to 30-min ahead) and satellite observations (up to 6h ahead). In this study, we integrate these two complementary points of view on the cloud cover in a single machine learning framework to improve intra-hour (up to 60-min ahead) irradiance forecasting. Both deterministic and probabilistic predictions are evaluated in different weather conditions (clear-sky, cloudy, overcast) and with different input configurations (sky images, satellite observations and/or past irradiance values). Our results show that the hybrid model benefits predictions in clear-sky conditions and improves longer-term forecasting. This study lays the groundwork for future novel approaches of combining sky images and satellite observations in a single learning framework to advance solar nowcasting.


title: From Attribution Maps to Human-Understandable Explanations through Concept Relevance Propagation

abstract: The field of eXplainable Artificial Intelligence (XAI) aims to bring transparency to today's powerful but opaque deep learning models. While local XAI methods explain individual predictions in form of attribution maps, thereby identifying where important features occur (but not providing information about what they represent), global explanation techniques visualize what concepts a model has generally learned to encode. Both types of methods thus only provide partial insights and leave the burden of interpreting the model's reasoning to the user. In this work we introduce the Concept Relevance Propagation (CRP) approach, which combines the local and global perspectives and thus allows answering both the "where" and "what" questions for individual predictions. We demonstrate the capability of our method in various settings, showcasing that CRP leads to more human interpretable explanations and provides deep insights into the model's representation and reasoning through concept atlases, concept composition analyses, and quantitative investigations of concept subspaces and their role in fine-grained decision making.


title: Fifty years of Schallamach waves: From rubber friction to nanoscale fracture

abstract: The question of how soft polymers slide against hard surfaces is of significant scientific interest, given its practical implications. Specifically, such sytems commonly show interesting stick-slip dynamics, wherein the interface moves intermittently despite uniform remote loading. \mt{The year 2021 marked the 50$^{th}$ anniversary of the publication of a seminal paper by Adolf Schallamach (\emph{Wear}, 1971)} that first revealed an intimate link between stick-slip and moving detachment waves, now called Schallamach waves. We place Schallamach's results in a broader context and review subsequent investigations of stick-slip, before discussing recent observations of solitary Schallamach waves. This variant is not observable in standard contacts so that a special cylindrical contact must be used to quantify its properties. The latter configuration also reveals the occurrence of a dual wave -- the so-called separation pulse -- that propagates in a direction opposite to Schallamach waves. We show how the dual wave and other, more general, Schallamach-type waves can be described using continuum theory, and provide pointers for future research. In the process, fundamental analogues of Schallamach-type waves emerge in nanoscale mechanics and interface fracture. The result is an on-going application of lessons learnt from Schallamach-type waves to better understand these latter phenomena.


title: Deep Neural Patchworks: Coping with Large Segmentation Tasks

abstract: Convolutional neural networks are the way to solve arbitrary image segmentation tasks. However, when images are large, memory demands often exceed the available resources, in particular on a common GPU. Especially in biomedical imaging, where 3D images are common, the problems are apparent. A typical approach to solve this limitation is to break the task into smaller subtasks by dividing images into smaller image patches. Another approach, if applicable, is to look at the 2D image sections separately, and to solve the problem in 2D. Often, the loss of global context makes such approaches less effective; important global information might not be present in the current image patch, or the selected 2D image section. Here, we propose Deep Neural Patchworks (DNP), a segmentation framework that is based on hierarchical and nested stacking of patch-based networks that solves the dilemma between global context and memory limitations.


title: Variational Meta Reinforcement Learning for Social Robotics

abstract: With the increasing presence of robots in our every-day environments, improving their social skills is of utmost importance. Nonetheless, social robotics still faces many challenges. One bottleneck is that robotic behaviors need to be often adapted as social norms depend strongly on the environment. For example, a robot should navigate more carefully around patients in a hospital compared to workers in an office. In this work, we investigate meta-reinforcement learning (meta-RL) as a potential solution. Here, robot behaviors are learned via reinforcement learning where a reward function needs to be chosen so that the robot learns an appropriate behavior for a given environment. We propose to use a variational meta-RL procedure that quickly adapts the robots' behavior to new reward functions. As a result, given a new environment different reward functions can be quickly evaluated and an appropriate one selected. The procedure learns a vectorized representation for reward functions and a meta-policy that can be conditioned on such a representation. Given observations from a new reward function, the procedure identifies its representation and conditions the meta-policy to it. While investigating the procedures' capabilities, we realized that it suffers from posterior collapse where only a subset of the dimensions in the representation encode useful information resulting in a reduced performance. Our second contribution, a radial basis function (RBF) layer, partially mitigates this negative effect. The RBF layer lifts the representation to a higher dimensional space, which is more easily exploitable for the meta-policy. We demonstrate the interest of the RBF layer and the usage of meta-RL for social robotics on four robotic simulation tasks.


title: Dependency, Data and Decolonisation: A Framework for Decolonial Thinking in Collaborative AI Research

abstract: This essay seeks to tie together thoughts on the political economy of academia, the inequities in access to the academic means of production and decolonial practice in data empowerment. To demonstrate this I will provide a brief analysis of the neo-colonial, extractive practices of the Western Academy, introduce concepts around decolonial AI practice and then use these to form an investigative framework. Using this framework, I present a brief case study of the AirQo project in Kampala, Uganda. The project aims to deploy a low-cost air pollution sensor network across the city, using machine learning methods to calibrate these sensors against reference instruments, providing high-quality air pollution data at a far lower cost.


title: Improving Students' Academic Performance with AI and Semantic Technologies

abstract: Artificial intelligence and semantic technologies are evolving and have been applied in various research areas, including the education domain. Higher Education institutions strive to improve students' academic performance. Early intervention to at-risk students and a reasonable curriculum is vital for students' success. Prior research opted for deploying traditional machine learning models to predict students' performance. In terms of curriculum semantic analysis, after conducting a comprehensive systematic review regarding the use of semantic technologies in the Computer Science curriculum, a major finding of the study is that technologies used to measure similarity have limitations in terms of accuracy and ambiguity in the representation of concepts, courses, etc. To fill these gaps, in this study, three implementations were developed, that is, to predict students' performance using marks from the previous semester, to model a course representation in a semantic way and compute the similarity, and to identify the prerequisite between two similar courses. Regarding performance prediction, we used the combination of Genetic Algorithm and Long-Short Term Memory (LSTM) on a dataset from a Brazilian university containing 248730 records. As for similarity measurement, we deployed BERT to encode the sentences and used cosine similarity to obtain the distance between courses. With respect to prerequisite identification, TextRazor was applied to extract concepts from course description, followed by employing SemRefD to measure the degree of prerequisite between two concepts. The outcomes of this study can be summarized as: (i) a breakthrough result improves Manrique's work by 2.5% in terms of accuracy in dropout prediction; (ii) uncover the similarity between courses based on course description; (iii) identify the prerequisite over three compulsory courses of School of Computing at ANU.


title: Bias in the number of steps in the Euclidean algorithm and a conjecture of Ito on Dedekind sums

abstract: We investigate the number of steps taken by three variants of the Euclidean algorithm on average over Farey fractions. We show asymptotic formulae for these averages restricted to the interval $(0,1/2)$, establishing that they behave differently on $(0,1/2)$ than they do on $(1/2,1)$. These results are tightly linked with the distribution of lengths of certain continued fraction expansions as well as the distribution of the involved partial quotients. As an application, we prove a conjecture of Ito on the distribution of values of Dedekind sums. The main argument is based on earlier work of Zhabitskaya, Ustinov, Bykovski\u{i} and others, ultimately dating back to Heilbronn, relating the quantities in question to counting solutions to a certain system of Diophantine inequalities. The above restriction to only half of the Farey fractions introduces additional complications.


title: Prote\c{c}\~ao intelectual de obras produzidas por sistemas baseados em intelig\^encia artificial: uma vis\~ao tecnicista sobre o tema

abstract: The pervasiveness of Artificial Intelligence (AI) is unquestionable in our society. Even in the arts, AI is present. A notorious case is the song "Hey Ya!" of the OutKast group, successful in the 2000s. At this time, the music industry began to make decisions based on data to strategize based on predictions of listeners' habits. This case is just one of the countless examples of AI applications in the arts. The advent of deep learning made it possible to build systems capable of accurately recognizing artistic style in paintings. Content generation is also possible; for example, Deepart customizes images from two \textit{inputs}: 1) an image to be customized; 2) a style of painting. The generation of songs according to specific styles from AI-based systems is also possible. Such possibilities raise questions about the intellectual property of such works. On this occasion, who owns the copyright of a work produced from a system based on Artificial Intelligence? To the creator of the AI? The company/corporation that subsidized the development of this system? Or AI itself as a creator? This essay aims to contribute with a technicist view on the discussion of copyright applicability from works produced by AI.


title: Data Governance in the Age of Large-Scale Data-Driven Language Technology

abstract: The recent emergence and adoption of Machine Learning technology, and specifically of Large Language Models, has drawn attention to the need for systematic and transparent management of language data. This work proposes an approach to global language data governance that attempts to organize data management amongst stakeholders, values, and rights. Our proposal is informed by prior work on distributed governance that accounts for human values and grounded by an international research collaboration that brings together researchers and practitioners from 60 countries. The framework we present is a multi-party international governance structure focused on language data, and incorporating technical and organizational tools needed to support its work.


title: A Perspective on K-12 AI Education

abstract: Artificial intelligence (AI), which enables machines to learn to perform a task by training on diverse datasets, is one of the most revolutionary developments in scientific history. Although AI and especially deep learning is relatively new, it has already had transformative impact on medicine, biology, transportation, entertainment, and beyond. As AI changes our daily lives at an increasingly fast pace, we are challenged with preparing our society for an AI-driven future. To this end, a critical step is to ensure an AI-ready workforce through education. Advocates of beginning instruction of AI basics at the K-12 level typically note benefits to the workforce, economy, and national security. In this complementary perspective, we discuss why learning AI is beneficial for motivating students and promoting creative thinking, and how to develop a module-based approach that optimizes learning outcomes. We hope to excite and engage more members of the education community to join the effort to advance K-12 AI education in the USA and worldwide.


title: Decay property of solutions to the wave equation with space-dependent damping, absorbing nonlinearity, and polynomially decaying data

abstract: We study the large time behavior of solutions to the semilinear wave equation with space-dependent damping and absorbing nonlinearity in the whole space or exterior domains. Our result shows how the amplitude of the damping coefficient, the power of the nonlinearity, and the decay rate of the initial data at the spatial infinity determine the decay rates of the energy and the $L^2$-norm of the solution. In Appendix, we also give a survey of basic results on the local and global existence of solutions and the properties of weight functions used in the energy method.


title: Quantum Measurement Theory as simply explained by N G van Kampen

abstract: A translation is provided of the nonspecialist article by N G van Kampen which seeks to dispel much of the mysticism surrounding quantum measurement.


title: A Transparency Index Framework for AI in Education

abstract: Numerous AI ethics checklists and frameworks have been proposed focusing on different dimensions of ethical AI such as fairness, explainability, and safety. Yet, no such work has been done on developing transparent AI systems for real-world educational scenarios. This paper presents a Transparency Index framework that has been iteratively co-designed with different stakeholders of AI in education, including educators, ed-tech experts, and AI practitioners. We map the requirements of transparency for different categories of stakeholders of AI in education and demonstrate that transparency considerations are embedded in the entire AI development process from the data collection stage until the AI system is deployed in the real world and iteratively improved. We also demonstrate how transparency enables the implementation of other ethical AI dimensions in Education like interpretability, accountability, and safety. In conclusion, we discuss the directions for future research in this newly emerging field. The main contribution of this study is that it highlights the importance of transparency in developing AI-powered educational technologies and proposes an index framework for its conceptualization for AI in education.


title: To incentivize or not: Impact of blockchain-based cryptoeconomic tokens on human information sharing behavior

abstract: Cryptoeconomic incentives in the form of blockchain-based tokens are seen as an enabler of the sharing economy that could shift society towards greater sustainability. Nevertheless, knowledge of the impact of these tokens on human sharing behavior is still limited and this poses a challenge to the design of effective cryptoeconomic incentives. This study applies the theory of self-determination to investigate the impact of such tokens on human behavior in an information-sharing scenario. By utilizing an experimental methodology in the form of a randomized control trial with a 2x2 factorial design involving 132 participants, the effects of two token incentives on human information-sharing behavior are analyzed. Individuals obtain these tokens in exchange for their shared information. Based on the collected tokens, individuals receive a monetary payment and build reputation. Besides investigating the effect of these incentives on the quantity of shared information, the study includes quality characteristics of the information, such as accuracy and contextualization. The focus on quantity while excluding quality has been identified as a limitation in previous work. In addition to confirming previously known effects such as a crowding-out of intrinsic motivation by incentives, which also exists for blockchain-based tokens, the findings of this paper point to a hitherto unreported interaction effect between multiple tokens when applied simultaneously. The findings are critically discussed and put into the context of recent work and ethical considerations. The theory-based-empirical study is of interest to those investigating the effect of cryptoeconomic tokens or digital currencies on human behavior and supports the community in the design of effective personalized incentives for sharing economies.


title: Improved Cardiac Arrhythmia Prediction Based on Heart Rate Variability Analysis

abstract: Many types of ventricular and atrial cardiac arrhythmias have been discovered in clinical practice in the past 100 years, and these arrhythmias are a major contributor to sudden cardiac death. Ventricular tachycardia, ventricular fibrillation, and paroxysmal atrial fibrillation are the most commonly-occurring and dangerous arrhythmias, therefore early detection is crucial to prevent any further complications and reduce fatalities. Implantable devices such as pacemakers are commonly used in patients at high risk of sudden cardiac death. While great advances have been made in medical technology, there remain significant challenges in effective management of common arrhythmias. This thesis proposes novel arrhythmia detection and prediction methods to differentiate cardiac arrhythmias from non-life-threatening cardiac events, to increase the likelihood of detecting events that may lead to mortality, as well as reduce the incidence of unnecessary therapeutic intervention. The methods are based on detailed analysis of Heart Rate Variability (HRV) information. The results of the work show good performance of the proposed methods and support the potential for their deployment in resource-constrained devices for ventricular and atrial arrhythmia prediction, such as implantable pacemakers and defibrillators.


title: Sensors for Mobile Robots

abstract: A sensor is a device that converts a physical parameter or an environmental characteristic (e.g., temperature, distance, speed, etc.) into a signal that can be digitally measured and processed to perform specific tasks. Mobile robots need sensors to measure properties of their environment, thus allowing for safe navigation, complex perception and corresponding actions, and effective interactions with other agents that populate it. Sensors used by mobile robots range from simple tactile sensors, such as bumpers, to complex vision-based sensors such as structured light RGB-D cameras. All of them provide a digital output (e.g., a string, a set of values, a matrix, etc.) that can be processed by the robot's computer. Such output is typically obtained by discretizing one or more analog electrical signals by using an Analog to Digital Converter (ADC) included in the sensor. In this chapter we present the most common sensors used in mobile robotics, providing an introduction to their taxonomy, basic features, and specifications. The description of the functionalities and the types of applications follows a bottom-up approach: the basic principles and components on which the sensors are based are presented before describing real-world sensors, which are generally based on multiple technologies and basic devices.


title: The Beyond the Fence Musical and Computer Says Show Documentary

abstract: During 2015 and early 2016, the cultural application of Computational Creativity research and practice took a big leap forward, with a project where multiple computational systems were used to provide advice and material for a new musical theatre production. Billed as the world's first 'computer musical... conceived by computer and substantially crafted by computer', Beyond The Fence was staged in the Arts Theatre in London's West End during February and March of 2016. Various computational approaches to analytical and generative sub-projects were used to bring about the musical, and these efforts were recorded in two 1-hour documentary films made by Wingspan Productions, which were aired on SkyArts under the title Computer Says Show. We provide details here of the project conception and execution, including details of the systems which took on some of the creative responsibility in writing the musical, and the contributions they made. We also provide details of the impact of the project, including a perspective from the two (human) writers with overall control of the creative aspects the musical.


title: The Different Faces of AI Ethics Across the World: A Principle-Implementation Gap Analysis

abstract: Artificial Intelligence (AI) is transforming our daily life with several applications in healthcare, space exploration, banking and finance. These rapid progresses in AI have brought increasing attention to the potential impacts of AI technologies on society, with ethically questionable consequences. In recent years, several ethical principles have been released by governments, national and international organisations. These principles outline high-level precepts to guide the ethical development, deployment, and governance of AI. However, the abstract nature, diversity, and context-dependency of these principles make them difficult to implement and operationalize, resulting in gaps between principles and their execution. Most recent work analysed and summarized existing AI principles and guidelines but they did not provide findings on principle-implementation gaps and how to mitigate them. These findings are particularly important to ensure that AI implementations are aligned with ethical principles and values. In this paper, we provide a contextual and global evaluation of current ethical AI principles for all continents, with the aim to identify potential principle characteristics tailored to specific countries or applicable across countries. Next, we analyze the current level of AI readiness and current implementations of ethical AI principles in different countries, to identify gaps in the implementation of AI principles and their causes. Finally, we propose recommendations to mitigate the principle-implementation gaps.


title: Fairness and Explainability in Automatic Decision-Making Systems. A challenge for computer science and law

abstract: The paper offers a contribution to the interdisciplinary constructs of analyzing fairness issues in automatic algorithmic decisions. Section 1 shows that technical choices in supervised learning have social implications that need to be considered. Section 2 proposes a contextual approach to the issue of unintended group discrimination, i.e. decision rules that are facially neutral but generate disproportionate impacts across social groups (e.g., gender, race or ethnicity). The contextualization will focus on the legal systems of the United States on the one hand and Europe on the other. In particular, legislation and case law tend to promote different standards of fairness on both sides of the Atlantic. Section 3 is devoted to the explainability of algorithmic decisions; it will confront and attempt to cross-reference legal concepts (in European and French law) with technical concepts and will highlight the plurality, even polysemy, of European and French legal texts relating to the explicability of algorithmic decisions. The conclusion proposes directions for further research.


title: Does Crypto Kill? Relationship between Electricity Consumption Carbon Footprints and Bitcoin Transactions

abstract: Cryptocurrencies are gaining more popularity due to their security, making counterfeits impossible. However, these digital currencies have been criticized for creating a large carbon footprint due to their algorithmic complexity and decentralized system design for proof of work and mining. We hypothesize that the carbon footprint of cryptocurrency transactions has a higher dependency on carbon-rich fuel sources than green or renewable fuel sources. We provide a machine learning framework to model such transactions and correlate them with the electricity generation patterns to estimate and analyze their carbon cost.


title: Perturbation Calculation of the Uniform Electron Gas with a Transcorrelated Hamiltonian

abstract: With a transcorrelated Hamiltonian, we perform a many body perturbation (MBPT) calculation on the uniform electron gas in the high density regime. By using a correlation factor optimised for a single determinant Jastrow ansatz, the second order correlation energy is calculated as $\frac{1-\ln2}{\pi^{2}}\ln(r_{s})-0.05075$. This already reproduces the exact logarithmic term of the random phase approximation (RPA) result, while the constant term is roughly $7\%$ larger than the RPA one. The close agreement with the RPA method demonstrates that the transcorrelated method offers a viable and potentially efficient method for treating metallic systems.


title: Sharp $L^1$-Approximation of the log-Heston SDE by Euler-type methods

abstract: We study the $L^1$-approximation of the log-Heston SDE at equidistant time points by Euler-type methods. We establish the convergence order $ 1/2-\epsilon$ for $\epsilon >0$ arbitrarily small, if the Feller index $\nu$ of the underlying CIR process satisfies $\nu > 1$. Thus, we recover the standard convergence order of the Euler scheme for SDEs with globally Lipschitz coefficients. Moreover, we discuss the case $\nu \leq 1$ and illustrate our findings by several numerical examples.


title: Shedding a PAC-Bayesian Light on Adaptive Sliced-Wasserstein Distances

abstract: The Sliced-Wasserstein distance (SW) is a computationally efficient and theoretically grounded alternative to the Wasserstein distance. Yet, the literature on its statistical properties -- or, more accurately, its generalization properties -- with respect to the distribution of slices, beyond the uniform measure, is scarce. To bring new contributions to this line of research, we leverage the PAC-Bayesian theory and a central observation that SW may be interpreted as an average risk, the quantity PAC-Bayesian bounds have been designed to characterize. We provide three types of results: i) PAC-Bayesian generalization bounds that hold on what we refer as adaptive Sliced-Wasserstein distances, i.e. SW defined with respect to arbitrary distributions of slices (among which data-dependent distributions), ii) a principled procedure to learn the distribution of slices that yields maximally discriminative SW, by optimizing our theoretical bounds, and iii) empirical illustrations of our theoretical findings.


title: High-performance computing for super-resolution microscopy on a cluster of computers

abstract: Multiple signal classification algorithm (MUSICAL) provides a super-resolution microscopy method. In the previous research, MUSICAL has enabled data-parallelism well on a desktop computer or a Linux-based server. However, the running time needs to be shorter. This paper will develop a new parallel MUSICAL with high efficiency and scalability on a cluster of computers. We achieve the purpose by using the optimal speed of the cluster cores, the latest parallel programming techniques, and the high-performance computing libraries, such as the Intel Threading Building Blocks (TBB), the Intel Math Kernel Library (MKL), and the unified parallel C++ (UPC++) for the cluster of computers. Our experimental results show that the new parallel MUSICAL achieves a speed-up of 240.29x within 10 seconds on the 256-core cluster with an efficiency of 93.86%. Our MUSICAL offers a high possibility for real-life applications to make super-resolution microscopy within seconds.


title: Propulsion, deformation, and confinement response of hollow nanocellulose millimotors

abstract: Micromotor and nanomotor particles are typically made using dense solid particles that can sediment or be trapped in confined flow environments. Creation of much larger motors should be possible if a very low-density system is used with sufficient strength to carry liquid and still experience propulsive motion. Light, dense millimotors should also be able to deform more than dense solid ones in constrictions. Millimotors are created from permeable capsules of bacterial cellulose that are coated with catalase-containing metal-organic frameworks, enabling reactive propulsion in aqueous hydrogen peroxide. The motion of the motors is quantified using particle tracking and the deformation is measured using microcapillary compression and flow through confined channels. Two different propulsion mechanisms are dominant depending on the motor surface chemistry: oxygen bubbles are expelled from hydrophilic millimotors, driving motion via reaction force and buoyancy. Hydrophobic millimotors remain attached to growing bubbles and move by buoyancy alone. Despite their large size, the low-density capsules compress to pass through contractions that would impede and be blocked by solid motors. The sparse structure but relatively large size of the motors enables them to transport significant volumes of liquid using minimal solid mass as a motor support structure.


title: Software Architectures for Mobile Robots

abstract: A software architecture defines the blueprints of a large computational system, and is thus a crucial part of the design and development effort. This task has been explored extensively in the context of mobile robots, resulting in a plethora of reference designs and implementations. As the software architecture defines the framework in which all components are implemented, it is naturally a very important aspect of a mobile robot system. In this chapter, we overview the requirements that the particular problem domain (a mobile robot system) imposes on the software framework. We discuss some of the current design solutions, provide a historical perspective on common frameworks, and outline directions for future development.


title: Fairness and Unfairness in Binary and Multiclass Classification: Quantifying, Calculating, and Bounding

abstract: We propose a new interpretable measure of unfairness, that allows providing a quantitative analysis of classifier fairness, beyond a dichotomous fair/unfair distinction. We show how this measure can be calculated when the classifier's conditional confusion matrices are known. We further propose methods for auditing classifiers for their fairness when the confusion matrices cannot be obtained or even estimated. Our approach lower-bounds the unfairness of a classifier based only on aggregate statistics, which may be provided by the owner of the classifier or collected from freely available data. We use the equalized odds criterion, which we generalize to the multiclass case. We report experiments on data sets representing diverse applications, which demonstrate the effectiveness and the wide range of possible uses of the proposed methodology. An implementation of the procedures proposed in this paper and as the code for running the experiments are provided in https://github.com/sivansabato/unfairness.


title: Spectral-line Survey of the Region of Massive Star Formation W51e1/e2 in the 4 mm Wavelength Range

abstract: We present the results of a spectral-line survey of the W51e1/e2 star-forming region at 68-88 GHz. 79 molecules and their isotopologues were detected, from simple diatomic or triatomic molecules, such as SO, SiO, and CCH, to complex organic compounds, such as CH$_3$OCH$_3$ or CH$_3$COCH$_3$. A number of lines that are absent from the Lovas list of molecular lines observed in space were detected, and most of these were identified. A significant number of the detected molecules are typical for hot cores. These include the neutral molecules HCOOCH$_3$, CH$_3$CH$_2$OH, CH$_3$COCH$_3$ etc, which are currently believed to exist in the gas phase only in hot cores and shock-heated gas. In addition, vibrationally excited C$_4$H and HC$_3$N lines with upper-level energies of several hundred Kelvins were found. Such lines can arise only in hot gas with temperatures on the order of 100 K or higher. Apart from neutral molecules, various molecular ions were also detected. Some of these (HC$^{18}$O$^+$, H$^{13}$CO$^+$, and HCS$^+$) usually exist in molecular clouds with high visual extinctions. Potential formation pathways of complex organic molecules (COMs) and of hydrocarbons, along with nitriles, are considered. These formation routes are first discussed in the context of laboratory experiments elucidating the synthesis of organic molecules in interstellar ices in cold molecular clouds, followed by sublimation into the gas phase in the hot core stage. Thereafter, we discuss the predominant formation of hydrocarbons and their nitriles in the gas phase through bimolecular neutral-neutral reactions.


title: The Doppler-flip in HD100546 as a disk eruption: the elephant in the room of kinematic protoplanet searches

abstract: The interpretation of molecular-line data in terms of hydro dynamical simulations of planet-disk interactions fosters new hopes for the indirect detection of protoplanets. In a model-independent approach, embedded protoplanets should be found at the roots of abrupt Doppler flips in velocity centroid maps. However, the largest velocity perturbation known for an unwarped disk, in the disk of HD100546, leads to a conspicuous Doppler flip that coincides with a thick dust ring, in contradiction with an interpretation in terms of a >~ 1Mjup body. Here we present new ALMA observations of the 12CO(2-1) kinematics in HD\,100546, with a factor of two finer angular resolutions. We find that the disk rotation curve is consistent with a central mass 2.1 < M* /Msun < 2.3, and that the blue-shifted side of the Doppler flip is due to vertical motions, reminiscent of the disk wind proposed previously from blue-shifted SO lines. We tentatively propose a qualitative interpretation in terms of a surface disturbance to the Keplerian flow, i.e. a disk eruption, driven by an embedded outflow launched by a ~10Mearth body. Another interpretation involves a disk-mass-loading hot-spot at the convergence of an envelope accretion streamer.


title: Blockchain for Business Process Enactment: A Taxonomy and Systematic Literature Review

abstract: Blockchain has been proposed to facilitate the enactment of interorganisational business processes. For such processes, blockchain can guarantee the enforcement of rules and the integrity of execution traces - without the need for a centralised trusted party. However, the enactment of interorganisational processes pose manifold challenges. In this work, we ask what answers the research field offers in response to those challenges. To do so, we conduct a systematic literature review (SLR). As our guiding question, we investigate the guarantees and capabilities of blockchain-based enactment approaches. Based on resulting empirical evidence, we develop a taxonomy for blockchain-based enactment. We find that a wide range of approaches support traceability and correctness; however, research focusing on flexibility and scalability remains nascent. For all challenges, we point towards future research opportunities.


title: Lipschitz regularity of almost minimizers in one-phase problems driven by the $p$-Laplace operator

abstract: We prove that, given~$p>\max\left\{\frac{2n}{n+2},1\right\}$, the nonnegative almost minimizers of the nonlinear free boundary functional $$ J_p(u,\Omega):=\int_{\Omega}\Big( |\nabla u(x)|^p+\chi_{\{u>0\}}(x)\Big)\,dx$$ are Lipschitz continuous.


title: Analyzing the impact of feature selection on the accuracy of heart disease prediction

abstract: Heart Disease has become one of the most serious diseases that has a significant impact on human life. It has emerged as one of the leading causes of mortality among the people across the globe during the last decade. In order to prevent patients from further damage, an accurate diagnosis of heart disease on time is an essential factor. Recently we have seen the usage of non-invasive medical procedures, such as artificial intelligence-based techniques in the field of medical. Specially machine learning employs several algorithms and techniques that are widely used and are highly useful in accurately diagnosing the heart disease with less amount of time. However, the prediction of heart disease is not an easy task. The increasing size of medical datasets has made it a complicated task for practitioners to understand the complex feature relations and make disease predictions. Accordingly, the aim of this research is to identify the most important risk-factors from a highly dimensional dataset which helps in the accurate classification of heart disease with less complications. For a broader analysis, we have used two heart disease datasets with various medical features. The classification results of the benchmarked models proved that there is a high impact of relevant features on the classification accuracy. Even with a reduced number of features, the performance of the classification models improved significantly with a reduced training time as compared with models trained on full feature set.


title: Electrically tunable second harmonic generation in atomically thin ReS2

abstract: Electrical tuning of second-order nonlinearity in optical materials is attractive to strengthen and expand the functionalities of nonlinear optical technologies, though its implementation remains elusive. Here, we report the electrically tunable second-order nonlinearity in atomically thin ReS2 flakes benefiting from their distorted 1T crystal structure and interlayer charge transfer. Enabled by the efficient electrostatic control of the few-atomic-layer ReS2, we show that second harmonic generation (SHG) can be induced in odd-number-layered ReS2 flakes which are centrosymmetric and thus without intrinsic SHG. Moreover, the SHG can be precisely modulated by the electric field, reversibly switching from almost zero to an amplitude more than one order of magnitude stronger than that of the monolayer MoS2. For the even-number-layered ReS2 flakes with the intrinsic SHG, the external electric field could be leveraged to enhance the SHG. We further perform the first-principles calculations which suggest that the modification of in-plane second-order hyperpolarizability by the redistributed interlayer-transferring charges in the distorted 1T crystal structure underlies the electrically tunable SHG in ReS2. With its active SHG tunability while using the facile electrostatic control, our work may further expand the nonlinear optoelectronic functions of two-dimensional materials for developing electrically controllable nonlinear optoelectronic devices.


title: Combining Genetic Programming and Particle Swarm Optimization to Simplify Rugged Landscapes Exploration

abstract: Most real-world optimization problems are difficult to solve with traditional statistical techniques or with metaheuristics. The main difficulty is related to the existence of a considerable number of local optima, which may result in the premature convergence of the optimization process. To address this problem, we propose a novel heuristic method for constructing a smooth surrogate model of the original function. The surrogate function is easier to optimize but maintains a fundamental property of the original rugged fitness landscape: the location of the global optimum. To create such a surrogate model, we consider a linear genetic programming approach enhanced by a self-tuning fitness function. The proposed algorithm, called the GP-FST-PSO Surrogate Model, achieves satisfactory results in both the search for the global optimum and the production of a visual approximation of the original benchmark function (in the 2-dimensional case).


title: Fast Exact String to D-Texts Alignments

abstract: In recent years, aligning a sequence to a pangenome has become a central problem in genomics and pangenomics. A fast and accurate solution to this problem can serve as a toolkit to many crucial tasks such as read-correction, Multiple Sequences Alignment (MSA), genome assemblies, variant calling, just to name a few. In this paper we propose a new, fast and exact method to align a string to a D-string, the latter possibly representing an MSA, a pan-genome or a partial assembly. An implementation of our tool dsa is publicly available at https://github.com/urbanslug/dsa


title: Spin fields for the spinning particle

abstract: We propose an analogue of spin fields for the relativistic RNS-particle in 4 dimensions, in order to describe Ramond-Ramond states as "two-particle" excitations on the world line. On a natural representation space we identify a differential whose cohomology agrees with RR-fields equations. We then discuss the non-linear theory encoded in deformations of the latter by background fields. We also formulate a sigma model for this spin field from which we recover the RNS-formulation by imposing suitable constraints.


title: Pointwise attractors which are not strict

abstract: We deal with the finite family $\mathcal{F}$ of continuous maps on the Hausdorff space. A nonempty compact subset $A$ of such space is called a strict attractor if it has an open neighborhood $U$ such that $A=\lim_{n\to\infty}\mathcal{F}^n(S)$ for every nonempty compact $S\subset U$. Every strict attractor is a pointwise attractor, which means that the set $\{x\in X ; \lim_{n\to\infty}\mathcal{F}^n(x)=A\}$ contains $A$ in its interior. We present a class of examples of pointwise attractors - from the finite set to the Sierpi\'nski carpet - which are not strict when we add to the system one nonexpansive map.


title: Quickest Change Detection in the Presence of Transient Adversarial Attacks

abstract: We study a monitoring system in which the distributions of sensors' observations change from a nominal distribution to an abnormal distribution in response to an adversary's presence. The system uses the quickest change detection procedure, the Shewhart rule, to detect the adversary that uses its resources to affect the abnormal distribution, so as to hide its presence. The metric of interest is the probability of missed detection within a predefined number of time-slots after the changepoint. Assuming that the adversary's resource constraints are known to the detector, we find the number of required sensors to make the worst-case probability of missed detection less than an acceptable level. The distributions of observations are assumed to be Gaussian, and the presence of the adversary affects their mean. We also provide simulation results to support our analysis.


title: Portfolio Transformer for Attention-Based Asset Allocation

abstract: Traditional approaches to financial asset allocation start with returns forecasting followed by an optimization stage that decides the optimal asset weights. Any errors made during the forecasting step reduce the accuracy of the asset weightings, and hence the profitability of the overall portfolio. The Portfolio Transformer (PT) network, introduced here, circumvents the need to predict asset returns and instead directly optimizes the Sharpe ratio, a risk-adjusted performance metric widely used in practice. The PT is a novel end-to-end portfolio optimization framework, inspired by the numerous successes of attention mechanisms in natural language processing. With its full encoder-decoder architecture, specialized time encoding layers, and gating components, the PT has a high capacity to learn long-term dependencies among portfolio assets and hence can adapt more quickly to changing market conditions such as the COVID-19 pandemic. To demonstrate its robustness, the PT is compared against other algorithms, including the current LSTM-based state of the art, on three different datasets, with results showing that it offers the best risk-adjusted performance.


title: Towards better Interpretable and Generalizable AD detection using Collective Artificial Intelligence

abstract: Alzheimer's Disease is the most common cause of dementia. Accurate diagnosis and prognosis of this disease are essential to design an appropriate treatment plan, increasing the life expectancy of the patient. Intense research has been conducted on the use of machine learning to identify Alzheimer's Disease from neuroimaging data, such as structural magnetic resonance imaging. In recent years, advances of deep learning in computer vision suggest a new research direction for this problem. Current deep learning-based approaches in this field, however, have a number of drawbacks, including the interpretability of model decisions, a lack of generalizability information and a lower performance compared to traditional machine learning techniques. In this paper, we design a two-stage framework to overcome these limitations. In the first stage, an ensemble of 125 U-Nets is used to grade the input image, producing a 3D map that reflects the disease severity at voxel-level. This map can help to localize abnormal brain areas caused by the disease. In the second stage, we model a graph per individual using the generated grading map and other information about the subject. We propose to use a graph convolutional neural network classifier for the final classification. As a result, our framework demonstrates comparative performance to the state-of-the-art methods in different datasets for both diagnosis and prognosis. We also demonstrate that the use of a large ensemble of U-Nets offers a better generalization capacity for our framework.


title: Rites de Passage: Elucidating Displacement to Emplacement of Refugees on Twitter

abstract: Social media deliberations allow to explore refugee-related is-sues. AI-based studies have investigated refugee issues mostly around a specific event and considered unimodal approaches. Contrarily, we have employed a multimodal architecture for probing the refugee journeys from their home to host nations. We draw insights from Arnold van Gennep's anthropological work 'Les Rites de Passage', which systematically analyzed an individual's transition from one group or society to another. Based on Gennep's separation-transition-incorporation framework, we have identified four phases of refugee journeys: Arrival of Refugees, Temporal stay at Asylums, Rehabilitation, and Integration of Refugees into the host nation. We collected 0.23 million multimodal tweets from April 2020 to March 2021 for testing this proposed frame-work. We find that a combination of transformer-based language models and state-of-the-art image recognition models, such as fusion of BERT+LSTM and InceptionV4, can out-perform unimodal models. Subsequently, to test the practical implication of our proposed model in real-time, we have considered 0.01 million multimodal tweets related to the 2022 Ukrainian refugee crisis. An F1-score of 71.88 % for this 2022 crisis confirms the generalizability of our proposed framework.


title: Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method

abstract: In inverse problems, the parameters of a model are estimated based on observations of the model response. The Bayesian approach is powerful for solving such problems; one formulates a prior distribution for the parameter state that is updated with the observations to compute the posterior parameter distribution. Solving for the posterior distribution can be challenging when, e.g., prior and posterior significantly differ from one another and/or the parameter space is high-dimensional. We use a sequence of importance sampling measures that arise by tempering the likelihood to approach inverse problems exhibiting a significant distance between prior and posterior. Each importance sampling measure is identified by cross-entropy minimization as proposed in the context of Bayesian inverse problems in Engel et al. (2021). To efficiently address problems with high-dimensional parameter spaces we set up the minimization procedure in a low-dimensional subspace of the original parameter space. The principal idea is to analyse the spectrum of the second-moment matrix of the gradient of the log-likelihood function to identify a suitable subspace. Following Zahm et al. (2021), an upper bound on the Kullback-Leibler-divergence between full-dimensional and subspace posterior is provided, which can be utilized to determine the effective dimension of the inverse problem corresponding to a prescribed approximation error bound. We suggest heuristic criteria for optimally selecting the number of model and model gradient evaluations in each iteration of the importance sampling sequence. We investigate the performance of this approach using examples from engineering mechanics set in various parameter space dimensions.


title: 6G-AUTOR: Autonomic CSI-Free Transceiver via Realtime On-Device Signal Analytics

abstract: Next-generation wireless systems aim at fulfilling diverse application requirements but fundamentally rely on point-to-point transmission qualities. Aligning with recent AI-enabled wireless implementations, this paper introduces autonomic radios, 6G-AUTOR, that leverage novel algorithm-hardware separation platforms, softwarization of transmission (TX) and reception (RX) operations, and automatic reconfiguration of RF frontends, to support link performance and resilience. As a comprehensive transceiver solution, our design encompasses several ML-driven models, each enhancing a specific aspect of either TX or RX, leading to robust transceiver operation under tight constraints of future wireless systems. A data-driven radio management module was developed via deep Q-networks to support fast-reconfiguration of TX resource blocks (RB) and proactive multi-agent access. Also, a ResNet-inspired fast-beamforming solution was employed to enable robust communication to multiple receivers over the same RB, which has potential applications in realisation of cell-free infrastructures. As a receiver the system was equipped with a capability of ultra-broadband spectrum recognition. Apart from this, a fundamental tool - automatic modulation classification (AMC) which involves a complex correntropy extraction, followed by a convolutional neural network (CNN)-based classification, and a deep learning-based LDPC decoder were added to improve the reception quality and radio performance. Simulations of individual algorithms demonstrate that under appropriate training, each of the corresponding radio functions have either outperformed or have performed on-par with the benchmark solutions.


title: 4D Geometric Shell Shaping with Applications to 400ZR

abstract: Geometric shell shaping is introduced and evaluated for reach increase and nonlinearity tolerance in terms of MI against PM-16QAM and PS-PM-16QAM in a 400ZR compatible transmission setup.


title: CNTFET quaternary multipliers are less efficient than the corresponding binary ones

abstract: We compare N*N quaternary digit and 2N*2N bit CNTFET multipliers in terms of Worst case delay, Chip area, Power and Power Delay Product (PDP) for N=1, N=2 and N=4. Both multipliers use Wallace reduction trees. HSpice simulations with 32-nm CNTFET parameters shows that the binary implementations are always more efficient: the 1*1 quit multiplier is far more complex than a 1*1 bit multiplier (AND gate) and generate both product and a carry terms. Even with half number of terms, the quaternary reduction tree has the same number of terms than the binary one, and uses quaternary adders that are also more complicated than the binary ones. The quaternary multipliers have larger worst case delays, more power dissipation and far more chip areas than the binary ones computing the same amount of information.


title: About Digital Twins, agents, and multiagent systems: a cross-fertilisation journey

abstract: Digital Twins (DTs) are rapidly emerging as a fundamental brick of engineering cyber-physical systems, but their notion is still mostly bound to specific business domains (e.g. manufacturing), goals (e.g. product design), or application domains (e.g. the Internet of Things). As such, their value as general purpose engineering abstractions is yet to be fully revealed. In this paper, we relate DTs with agents and multiagent systems, as the latter are arguably the most rich abstractions available for the engineering of complex socio-technical and cyber-physical systems, and the former could both fill in some gaps in agent-oriented engineering and benefit from an agent-oriented interpretation -- in a cross-fertilisation journey.


title: Demystifying the Global Convergence Puzzle of Learning Over-parameterized ReLU Nets in Very High Dimensions

abstract: This theoretical paper is devoted to developing a rigorous theory for demystifying the global convergence phenomenon in a challenging scenario: learning over-parameterized Rectified Linear Unit (ReLU) nets for very high dimensional dataset under very mild assumptions. A major ingredient of our analysis is a fine-grained analysis of random activation matrices. The essential virtue of dissecting activation matrices is that it bridges the dynamics of optimization and angular distribution in high-dimensional data space. This angle-based detailed analysis leads to asymptotic characterizations of gradient norm and directional curvature of objective function at each gradient descent iteration, revealing that the empirical loss function enjoys nice geometrical properties in the overparameterized setting. Along the way, we significantly improve existing theoretical bounds on both over-parameterization condition and learning rate with very mild assumptions for learning very high dimensional data. Moreover, we uncover the role of the geometrical and spectral properties of the input data in determining desired over-parameterization size and global convergence rate. All these clues allow us to discover a novel geometric picture of nonconvex optimization in deep learning: angular distribution in high-dimensional data space $\mapsto$ spectrums of overparameterized activation matrices $\mapsto$ favorable geometrical properties of empirical loss landscape $\mapsto$ global convergence phenomenon. Furthremore, our theoretical results imply that gradient-based nonconvex optimization algorithms have much stronger statistical guarantees with much milder over-parameterization condition than exisiting theory states for learning very high dimensional data, which is rarely explored so far.


title: Do interests affect grant application success? The role of organizational proximity

abstract: Bias in grant allocation is a critical issue, as the expectation is that grants are given to the best researchers, and not to applicants that are socially, organizationally, or topic-wise near-by the decision-makers. In this paper, we investigate the effect of organizational proximity, defined as an applicant with the same affiliation as one of the panel members (a near-by panelist), on the probability of getting a grant. This study is based on one of the most prominent grant schemes in Europe, with overall excellent scientists as panel members. Various aspects of this organizational proximity are analyzed: Who gains from it? Does it have a gender dimension? Is it bias, or can it be explained by performance differences? We do find that the probability to get funded increases significantly for those that apply in a panel where there is a panelist from the institution where the applicant has agreed to use the grant. At the same time, the effect differs between disciplines and countries, and men profit more of it than women do. Finally, depending on how one defines what counts as the best researchers, the near-by panelist effect can be interpreted as preferential attachment (quality links to quality) or as bias and particularism.


title: Flexible Group Fairness Metrics for Survival Analysis

abstract: Algorithmic fairness is an increasingly important field concerned with detecting and mitigating biases in machine learning models. There has been a wealth of literature for algorithmic fairness in regression and classification however there has been little exploration of the field for survival analysis. Survival analysis is the prediction task in which one attempts to predict the probability of an event occurring over time. Survival predictions are particularly important in sensitive settings such as when utilising machine learning for diagnosis and prognosis of patients. In this paper we explore how to utilise existing survival metrics to measure bias with group fairness metrics. We explore this in an empirical experiment with 29 survival datasets and 8 measures. We find that measures of discrimination are able to capture bias well whereas there is less clarity with measures of calibration and scoring rules. We suggest further areas for research including prediction-based fairness metrics for distribution predictions.


title: Model selection and robust inference of mutational signatures using Negative Binomial non-negative matrix factorization

abstract: The spectrum of mutations in a collection of cancer genomes can be described by a mixture of a few mutational signatures. The mutational signatures can be found using non-negative matrix factorization (NMF). To extract the mutational signatures we have to assume a distribution for the observed mutational counts and a number of mutational signatures. In most applications, the mutational counts are assumed to be Poisson distributed, and the rank is chosen by comparing the fit of several models with the same underlying distribution and different values for the rank using classical model selection procedures. However, the counts are often overdispersed, and thus the Negative Binomial distribution is more appropriate. We propose a Negative Binomial NMF with a patient specific dispersion parameter to capture the variation across patients. We also introduce a novel model selection procedure inspired by cross-validation to determine the number of signatures. Using simulations, we study the influence of the distributional assumption on our method together with other classical model selection procedures and we show that our model selection procedure is more robust at determining the correct number of signatures under model misspecification. We also show that our model selection procedure is more accurate than state-of-the-art methods for finding the true number of signatures. Other methods are highly overestimating the number of signatures when overdispersion is present. We apply our proposed analysis on a wide range of simulated data and on two real data sets from breast and prostate cancer patients. The code for our model selection procedure and negative binomial NMF is available in the R package SigMoS and can be found at https://github.com/MartaPelizzola/SigMoS.


title: The risk ethics of autonomous vehicles: a continuous trolley problem in regular road traffic

abstract: Is the ethics of autonomous vehicles (AVs) restricted to weighing lives in unavoidable accidents? We argue that AVs distribute risks between road users in regular traffic situations, either explicitly or implicitly. This distribution of risks raises ethically relevant questions that cannot be evaded by simple heuristics such as "hitting the brakes." Using an interactive, graphical representation of different traffic situations, we measured participants' preferences on driving maneuvers of AVs in a representative survey in Germany. Our participants' preferences deviated significantly from mere collision avoidance. Interestingly, our participants were willing to take risks themselves for the benefit of other road users suggesting that the social dilemma of AVs may lessen in a context of risk.


title: Future Computer Systems and Networking Research in the Netherlands: A Manifesto

abstract: Our modern society and competitive economy depend on a strong digital foundation and, in turn, on sustained research and innovation in computer systems and networks (CompSys). With this manifesto, we draw attention to CompSys as a vital part of ICT. Among ICT technologies, CompSys covers all the hardware and all the operational software layers that enable applications; only application-specific details, and often only application-specific algorithms, are not part of CompSys. Each of the Top Sectors of the Dutch Economy, each route in the National Research Agenda, and each of the UN Sustainable Development Goals pose challenges that cannot be addressed without groundbreaking CompSys advances. Looking at the 2030-2035 horizon, important new applications will emerge only when enabled by CompSys developments. Triggered by the COVID-19 pandemic, millions moved abruptly online, raising infrastructure scalability and data sovereignty issues; but governments processing social data and responsible social networks still require a paradigm shift in data sovereignty and sharing. AI already requires massive computer systems which can cost millions per training task, but the current technology leaves an unsustainable energy footprint including large carbon emissions. Computational sciences such as bioinformatics, and "Humanities for all" and "citizen data science", cannot become affordable and efficient until computer systems take a generational leap. Similarly, the emerging quantum internet depends on (traditional) CompSys to bootstrap operation for the foreseeable future. Large commercial sectors, including finance and manufacturing, require specialized computing and networking or risk becoming uncompetitive. And, at the core of Dutch innovation, promising technology hubs, deltas, ports, and smart cities, could see their promise stagger due to critical dependency on non-European technology.


title: Non-local order parameters for fermion chains via the partial transpose

abstract: In the last two decades, a vast variety of topological phases have been described, predicted, classified, proposed, and measured. While there is a certain unity in method and philosophy, the phenomenology differs wildly. This work deals with the simplest such case: fermions in one spatial dimension, in the presence of a symmetry group $G$ which contains anti-unitary symmetries. A complete classification of topological phases, in this case, is available. Nevertheless, these methods are to some extent lacking as they generally do not allow to determine the class of a given system easily. This paper will take up proposals for non-local order parameters defined through anti-unitary symmetries. They are shown to be homotopy invariants on a suitable set of ground states. For matrix product states, an interpretation of these invariants is provided: in particular, for a particle-hole symmetry, the invariant determines a real division super algebra $\mathbb{D}$ such that the bond algebra is a matrix algebra over $\mathbb{D}$.


title: Optimists at Heart: Why Do We Research Game AI? (Extended Version)

abstract: In this paper we survey the motivations behind contemporary game AI research by analysing individual publications, the researchers themselves, and the institutions that influence them. In doing so, we identify some negative effects on our field, caused both by external forces outside of our control as well as institutionalised behaviours that are easily overlooked. We suggest how we might begin to address some of these issues as a community, and reassert ourselves as the primary driving force behind the field.


title: Using sensitive data to prevent discrimination by artificial intelligence: Does the GDPR need a new exception?

abstract: Organisations can use artificial intelligence to make decisions about people for a variety of reasons, for instance, to select the best candidates from many job applications. However, AI systems can have discriminatory effects when used for decision-making. To illustrate, an AI system could reject applications of people with a certain ethnicity, while the organisation did not plan such ethnicity discrimination. But in Europe, an organisation runs into a problem when it wants to assess whether its AI system accidentally discriminates based on ethnicity: the organisation may not know the applicants' ethnicity. In principle, the GDPR bans the use of certain 'special categories of data' (sometimes called 'sensitive data'), which include data on ethnicity, religion, and sexual preference. The proposal for an AI Act of the European Commission includes a provision that would enable organisations to use special categories of data for auditing their AI systems. This paper asks whether the GDPR's rules on special categories of personal data hinder the prevention of AI-driven discrimination. We argue that the GDPR does prohibit such use of special category data in many circumstances. We also map out the arguments for and against creating an exception to the GDPR's ban on using special categories of personal data, to enable preventing discrimination by AI systems. The paper discusses European law, but the paper can be relevant outside Europe too, as many policymakers in the world grapple with the tension between privacy and non-discrimination policy.


title: Embedded Systems Education in the 2020s: Challenges, Reflections, and Future Directions

abstract: Embedded computing systems are pervasive in our everyday lives, imparting digital intelligence to a variety of electronic platforms used in our vehicles, smart appliances, wearables, mobile devices, and computers. The need to train the next generation of embedded systems designers and engineers with relevant skills across hardware, software, and their co-design remains pressing today. This paper describes the evolution of embedded systems education over the past two decades and challenges facing the designers and instructors of embedded systems curricula in the 2020s. Reflections from over a decade of teaching the design of embedded computing systems are presented, with insights on strategies that show promise to address these challenges. Lastly, some important future directions in embedded systems education are highlighted.


title: Intelligent Energy Management Systems -- A Review

abstract: Climate change has become a major problem for humanity in the last two decades. One of the reasons that caused it, is our daily energy waste. People consume electricity in order to use home/work appliances and devices and also reach certain levels of comfort while working or being at home. However, even though the environmental impact of this behavior is not immediately observed, it leads to increased CO2 emissions coming from energy generation from power plants. Confronting such a problem efficiently will affect both the environment and our society. Monitoring energy consumption in real-time, changing energy wastage behavior of occupants and using automations with incorporated energy savings scenarios, are ways to decrease global energy footprint. In this review, we study intelligent systems for energy management in residential, commercial and educational buildings, classifying them in two major categories depending on whether they provide direct or indirect control. The article also discusses what the strengths and weaknesses are, which optimization techniques do they use and finally, provide insights about how these systems can be improved in the future.


title: Marvolo: Programmatic Data Augmentation for Practical ML-Driven Malware Detection

abstract: Data augmentation has been rare in the cyber security domain due to technical difficulties in altering data in a manner that is semantically consistent with the original data. This shortfall is particularly onerous given the unique difficulty of acquiring benign and malicious training data that runs into copyright restrictions, and that institutions like banks and governments receive targeted malware that will never exist in large quantities. We present MARVOLO, a binary mutator that programmatically grows malware (and benign) datasets in a manner that boosts the accuracy of ML-driven malware detectors. MARVOLO employs semantics-preserving code transformations that mimic the alterations that malware authors and defensive benign developers routinely make in practice , allowing us to generate meaningful augmented data. Crucially, semantics-preserving transformations also enable MARVOLO to safely propagate labels from original to newly-generated data samples without mandating expensive reverse engineering of binaries. Further, MARVOLO embeds several key optimizations that keep costs low for practitioners by maximizing the density of diverse data samples generated within a given time (or resource) budget. Experiments using wide-ranging commercial malware datasets and a recent ML-driven malware detector show that MARVOLO boosts accuracies by up to 5%, while operating on only a small fraction (15%) of the potential input binaries.


title: Machine Learning Sensors

abstract: Machine learning sensors represent a paradigm shift for the future of embedded machine learning applications. Current instantiations of embedded machine learning (ML) suffer from complex integration, lack of modularity, and privacy and security concerns from data movement. This article proposes a more data-centric paradigm for embedding sensor intelligence on edge devices to combat these challenges. Our vision for "sensor 2.0" entails segregating sensor input data and ML processing from the wider system at the hardware level and providing a thin interface that mimics traditional sensors in functionality. This separation leads to a modular and easy-to-use ML sensor device. We discuss challenges presented by the standard approach of building ML processing into the software stack of the controlling microprocessor on an embedded system and how the modularity of ML sensors alleviates these problems. ML sensors increase privacy and accuracy while making it easier for system builders to integrate ML into their products as a simple component. We provide examples of prospective ML sensors and an illustrative datasheet as a demonstration and hope that this will build a dialogue to progress us towards sensor 2.0.


title: A simple model of knowledge percolation

abstract: We investigate how knowledge percolates and clusters in a given knowledge space. We introduce a simple model of knowledge organization in which each contribution spans a certain number of items. If this contribution overlaps with others above a certain threshold, they form a cluster. A contribution can also merge clusters together. We study the growth of global knowledge and the cluster dynamics, both showing a nontrivial behavior.


title: Ubiquitous knowledge empowers the Smart Factory: The impacts of a Service-oriented Digital Twin on enterprises' performance

abstract: While the Industry 4.0 is idolizing the potential of an artificial intelligence embedded into "things", it is neglecting the role of the human component, which is still indispensable in different manufacturing activities, such as a machine setup or maintenance operations. The present research study first proposes an Industrial Internet pyramid as emergent human-centric manufacturing paradigm within Industry 4.0 in which central is the role of a Ubiquitous Knowledge about the manufacturing system intuitively accessed and used by the manufacturing employees. Second, the prototype of a Service-oriented Digital Twin, which leverage on a flexible ontology-oriented knowledge structure and on augmented reality combined to a vocal interaction system for an intuitive knowledge retrieval and fruition, has been designed and developed to deliver this manufacturing knowledge. Two test-beds, complimentary for the problems in practice (the former on the maintenance-production interface in a large enterprise, the latter majorly focused in production and setups in a small and medium enterprise), show the significant benefits in terms of time, costs and process quality, thus validating the approach proposed. This research shows that a human-centric and knowledge-driven approach can drive the performance of Industry 4.0 initiatives and lead a Smart Factory towards its full potential.


title: Petri nets in epidemiology

abstract: In this work we study Petri nets associated to ordinary differential equations coming from epidemiological models. We propose a geometric procedure to obtain the basic reproduction number. This number is defined as the average number of secondary individuals during their entire infectious lifetime.


title: DLT Compliance Reporting

abstract: The IS discourse on the potential of distributed ledger technology (DLT) in the financial services has grown at a tremendous pace in recent years. Yet, little has been said about the related implications for the costly and highly regulated process of compliance reporting. Working with a group of representatives from industry and regulatory authorities, we employ the design science research methodology (DSR) in the design, development, and evaluation of an artefact, enabling the automated collection and enrichment of transactional data. Our findings indicate that DLT may facilitate the automation of key compliance processes through the implementation of a "pull-model", in which regulators can access compliance data in near real-time to stage aggregate exposures at the supranational level. Generalizing our preliminary results, we present four propositions on the implications of DLT in compliance. The findings contribute new practical insights on the topic of compliance to the growing IS discourse on DLT.


title: On the Effectiveness of Fine-tuning Versus Meta-reinforcement Learning

abstract: Intelligent agents should have the ability to leverage knowledge from previously learned tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have emerged as a popular solution to achieve this. However, meta-reinforcement learning (meta-RL) algorithms have thus far been restricted to simple environments with narrow task distributions. Moreover, the paradigm of pretraining followed by fine-tuning to adapt to new tasks has emerged as a simple yet effective solution in supervised and self-supervised learning. This calls into question the benefits of meta-learning approaches also in reinforcement learning, which typically come at the cost of high complexity. We hence investigate meta-RL approaches in a variety of vision-based benchmarks, including Procgen, RLBench, and Atari, where evaluations are made on completely novel tasks. Our findings show that when meta-learning approaches are evaluated on different tasks (rather than different variations of the same task), multi-task pretraining with fine-tuning on new tasks performs equally as well, or better, than meta-pretraining with meta test-time adaptation. This is encouraging for future research, as multi-task pretraining tends to be simpler and computationally cheaper than meta-RL. From these findings, we advocate for evaluating future meta-RL methods on more challenging tasks and including multi-task pretraining with fine-tuning as a simple, yet strong baseline.


title: Urban Exodus? Understanding Human Mobility in Britain During the COVID-19 Pandemic Using Facebook Data

abstract: Existing empirical work has focused on assessing the effectiveness of non-pharmaceutical interventions on human mobility to contain the spread of COVID-19. Less is known about the ways in which the COVID-19 pandemic has reshaped the spatial patterns of population movement within countries. Anecdotal evidence of an urban exodus from large cities to rural areas emerged during early phases of the pandemic across western societies. Yet, these claims have not been empirically assessed. Traditional data sources, such as censuses offer coarse temporal frequency to analyse population movement over short-time intervals. Drawing on a data set of 21 million observations from Facebook users, we aim to analyse the extent and evolution of changes in the spatial patterns of population movement across the rural-urban continuum in Britain over an 18-month period from March, 2020 to August, 2021. Our findings show an overall and sustained decline in population movement during periods of high stringency measures, with the most densely populated areas reporting the largest reductions. During these periods, we also find evidence of higher-than-average mobility from highly dense population areas to low densely populated areas, lending some support to claims of large-scale population movements from large cities. Yet, we show that these trends were temporary. Overall mobility levels trended back to pre-coronavirus levels after the easing of non-pharmaceutical interventions. Following these interventions, we also found a reduction in movement to low density areas and a rise in mobility to high density agglomerations. Overall, these findings reveal that while COVID-19 generated shock waves leading to temporary changes in the patterns of population movement in Britain, the resulting vibrations have not significantly reshaped the prevalent structures in the national pattern of population movement.


title: City-scale synthetic individual-level vehicle trip data

abstract: Trip data that records each vehicle's trip activity on the road network describes the operation of urban traffic from the individual perspective, and it is extremely valuable for transportation research. However, restricted by data privacy, the trip data of individual-level cannot be opened for all researchers, while the need for it is very urgent. In this paper, we produce a city-scale synthetic individual-level vehicle trip dataset by generating for each individual based on the historical trip data, where the availability and trip data privacy protection are balanced. Privacy protection inevitably affects the availability of data. Therefore, we have conducted numerous experiments to demonstrate the performance and reliability of the synthetic data in different dimensions and at different granularities to help users properly judge the tasks it can perform. The result shows that the synthetic data is consistent with the real data (i.e., historical data) on the aggregated level and reasonable from the individual perspective.


title: Minimizing Energy Consumption for End-to-End Slicing in 5G Wireless Networks and Beyond

abstract: End-to-End (E2E) network slicing enables wireless networks to provide diverse services on a common infrastructure. Each E2E slice, including resources of radio access network (RAN) and core network, is rented to mobile virtual network operators (MVNOs) to provide a specific service to end-users. RAN slicing, which is realized through wireless network virtualization, involves sharing the frequency spectrum and base station antennas in RAN. Similarly, in core slicing, which is achieved by network function virtualization, data center resources such as commodity servers and physical links are shared between users of different MVNOs. In this paper, we study E2E slicing with the aim of minimizing the total energy consumption. The stated optimization problem is non-convex that is solved by a sub-optimal algorithm proposed here. The simulation results show that our proposed joint power control, server and link allocation (JPSLA) algorithm achieves 30% improvement compared to the disjoint scheme, where RAN and core are sliced separately.


title: The Algorithmic Imprint

abstract: When algorithmic harms emerge, a reasonable response is to stop using the algorithm to resolve concerns related to fairness, accountability, transparency, and ethics (FATE). However, just because an algorithm is removed does not imply its FATE-related issues cease to exist. In this paper, we introduce the notion of the "algorithmic imprint" to illustrate how merely removing an algorithm does not necessarily undo or mitigate its consequences. We operationalize this concept and its implications through the 2020 events surrounding the algorithmic grading of the General Certificate of Education (GCE) Advanced (A) Level exams, an internationally recognized UK-based high school diploma exam administered in over 160 countries. While the algorithmic standardization was ultimately removed due to global protests, we show how the removal failed to undo the algorithmic imprint on the sociotechnical infrastructures that shape students', teachers', and parents' lives. These events provide a rare chance to analyze the state of the world both with and without algorithmic mediation. We situate our case study in Bangladesh to illustrate how algorithms made in the Global North disproportionately impact stakeholders in the Global South. Chronicling more than a year-long community engagement consisting of 47 inter-views, we present the first coherent timeline of "what" happened in Bangladesh, contextualizing "why" and "how" they happened through the lenses of the algorithmic imprint and situated algorithmic fairness. Analyzing these events, we highlight how the contours of the algorithmic imprints can be inferred at the infrastructural, social, and individual levels. We share conceptual and practical implications around how imprint-awareness can (a) broaden the boundaries of how we think about algorithmic impact, (b) inform how we design algorithms, and (c) guide us in AI governance.


title: Oxford-style Debates in Telecommunication and Computer Science Education

abstract: Oxford-style debating is a well-known tool in social sciences. Such formal discussions on particular topics are widely used by historians and sociologists. However, when we try to go beyond standard thinking, it turns out that Oxford-style debating can be a great educational tool in telecommunication and computer science. This article presents this unusual method of education at technical universities and in the IT industry, and describes its features and challenges. Best practices and examples of debating are provided, taking into account emerging topics in telecommunications and computer science, such as cybersecurity. The article also contains feedback from IT engineers who participated in Oxford-style debates. All this aims to encourage this form of education in telecommunication and computer science.


title: Driving and charging an EV in Australia: A real-world analysis

abstract: As outlined by the Intergovernmental Panel on Climate Change, electric vehicles offer the greatest decarbonisation potential for land transport, in addition to other benefits, including reduced fuel and maintenance costs, improved air quality, reduced noise pollution, and improved national fuel security. Owing to these benefits, governments worldwide are planning and rolling out EV-favourable policies, and major car manufacturers are committing to fully electrifying their offerings over the coming decades. With the number of EVs on the roads expected to increase, it is imperative to understand the effect of EVs on transport and energy systems. While unmanaged charging of EVs could potentially add stress to the electricity grid, managed charging of EVs could be beneficial to the grid in terms of improved demand-supply management and improved integration of renewable energy sources into the grid, as well as offer other ancillary services. To assess the impact of EVs on the electricity grid and their potential use as batteries-on-wheels through smart charging capabilities, decision-makers need to understand how current EV owners drive and charge their vehicles. As such, an emerging area of research focuses on understanding these behaviours. Some studies have used stated preference surveys of non-EV owners or data collected from EV trials to estimate EV driving and charging patterns. Other studies have tried to decipher EV owners' behaviour based on data collected from national surveys or as reported by EV owners. This study aims to fill this gap in the literature by collecting data on real-world driving and charging patterns of 239 EVs across Australia. To this effect, data collection from current EV owners via an application programming interface platform began in November 2021 and is currently live.


title: Cointegration and ARDL specification between the Dubai crude oil and the US natural gas market

abstract: This paper examines the relationship between the price of the Dubai crude oil and the price of the US natural gas using an updated monthly dataset from 1992 to 2018, incorporating the latter events in the energy markets. After employing a variety of unit root and cointegration tests, the long-run relationship is examined via the autoregressive distributed lag (ARDL) cointegration technique, along with the Toda-Yamamoto (1995) causality test. Our results indicate that there is a long-run relationship with a unidirectional causality running from the Dubai crude oil market to the US natural gas market. A variety of post specification tests indicate that the selected ARDL model is well-specified, and the results of the Toda-Yamamoto approach via impulse response functions, forecast error variance decompositions, and historical decompositions with generalized weights, show that the Dubai crude oil price retains a positive relationship and affects the US natural gas price.


title: Non-elementary categoricity and projective locally o-minimal classes

abstract: Given a cover $\mathbb{U}$ of a family of smooth complex algebraic varieties, we associate with it a class $\mathcal{U},$ containing $\mathbb{U}$, of structures locally definable in an o-minimal expansion of the reals. We prove that the class is $\aleph_0$-homogenous over submodels and stable. It follows that $\mathcal{U}$ is categorical in cardinality $\aleph_1.$ In the one-dimensional case we prove that a slight modification of $\mathcal{U}$ is an abstract elementary class categorical in all uncountable cardinals.


title: Surface electromagnetic waves near a black hole event horizon and their observational consequences

abstract: Localization phenomena in light scattering from random fluctuations of matter fields and spacetime metric near a black hole horizon were predicted to produce a pronounced peak in the angular distribution of second harmonic light in the direction normal to the horizon. Therefore, detection of second harmonic generation may become a viable observational tool to study spacetime physics near event horizons of astronomical black holes. The light localization phenomena near the horizon may be facilitated by the existence of surface electromagnetic wave solutions. In this communication we study such surface electromagnetic wave solutions near the horizon of a Schwarzschild metric describing a black hole in vacuum. We demonstrate that such surface wave solutions must appear when quantum gravity effects are taken into account. Potential observational evidence of this effect are also discussed.


title: Unsupervised Context Aware Sentence Representation Pretraining for Multi-lingual Dense Retrieval

abstract: Recent research demonstrates the effectiveness of using pretrained language models (PLM) to improve dense retrieval and multilingual dense retrieval. In this work, we present a simple but effective monolingual pretraining task called contrastive context prediction~(CCP) to learn sentence representation by modeling sentence level contextual relation. By pushing the embedding of sentences in a local context closer and pushing random negative samples away, different languages could form isomorphic structure, then sentence pairs in two different languages will be automatically aligned. Our experiments show that model collapse and information leakage are very easy to happen during contrastive training of language model, but language-specific memory bank and asymmetric batch normalization operation play an essential role in preventing collapsing and information leakage, respectively. Besides, a post-processing for sentence embedding is also very effective to achieve better retrieval performance. On the multilingual sentence retrieval task Tatoeba, our model achieves new SOTA results among methods without using bilingual data. Our model also shows larger gain on Tatoeba when transferring between non-English pairs. On two multi-lingual query-passage retrieval tasks, XOR Retrieve and Mr.TYDI, our model even achieves two SOTA results in both zero-shot and supervised setting among all pretraining models using bilingual data.


title: Novel Outlook on the Eigenvalue Problem for the Orbital Angular Momentum Operator

abstract: Based on the novel prescription for the power of a complex number, a new expression for the eigenfunction of the operator of the third component of the angular momentum is presented. These functions are normalizable, single valued and are invariant under the rotations at 2\pi for any, not necessary integer m - the eigenvalue of the operator of the third component of the angular momentum. For any real m these functions form an orthonormal set, therefore they may serve as a quantum mechanical eigenfunctions. The eigenfunctions and eigenvalues of the operator of the angular momentum operator squared, derived for the two different prescriptions for the square root are reported. The normalizable eigenfunctions of the operator of the angular momentum operator squared are presented in terms of hypergeometric functions, admitting integer as well as non-integer eigenvalues. It is shown that the purely integer spectrum is not the most general solution but is just the artifact of a particular choice of the Legendre functions as the pair of linearly independent solutions of the eigenvalue problem for the operator of the angular momentum operator squared.


title: A Compressed Sensing Faraday Depth Reconstruction Framework for the MeerKAT MIGHTEE-POL Survey

abstract: In this work we present a novel compute framework for reconstructing Faraday depth signals from noisy and incomplete spectro-polarimetric radio datasets. This framework is based on a compressed-sensing approach that addresses a number of outstanding issues in Faraday depth reconstruction in a systematic and scaleable manner. We apply this framework to early-release data from the MeerKAT MIGHTEE polarisation survey.


title: Optimal Vaccination in a SIRS Epidemic Model

abstract: We propose and solve an optimal vaccination problem within a deterministic compartmental model of SIRS type: the immunized population can become susceptible again, e.g.\ because of a not complete immunization power of the vaccine. A social planner thus aims at reducing the number of susceptible individuals via a vaccination campaign, while minimizing the social and economic costs related to the infectious disease. As a theoretical contribution, we provide a technical non-smooth verification theorem, guaranteeing that a semiconcave viscosity solution to the Hamilton-Jacobi-Bellman equation identifies with the minimal cost function, provided that the closed-loop equation admits a solution. Conditions under which the closed-loop equation is well-posed are then derived by borrowing results from the theory of \emph{Regular Lagrangian Flows}. From the applied point of view, we provide a numerical implementation of the model in a case study with quadratic instantaneous costs. Amongst other conclusions, we observe that in the long-run the optimal vaccination policy is able to keep the percentage of infected to zero, at least when the natural reproduction number and the reinfection rate are small.


title: Nezha: Deployable and High-Performance Consensus Using Synchronized Clocks

abstract: This paper presents a high-performance consensus protocol, Nezha, which can be deployed by cloud tenants without any support from their cloud provider. Nezha bridges the gap between protocols such as Multi-Paxos and Raft, which can be readily deployed and protocols such as NOPaxos and Speculative Paxos, that provide better performance, but require access to technologies such as programmable switches and in-network prioritization, which cloud tenants do not have. Nezha uses a new multicast primitive called deadline-ordered multicast (DOM). DOM uses high-accuracy software clock synchronization to synchronize sender and receiver clocks. Senders tag messages with deadlines in synchronized time; receivers process messages in deadline order, on or after their deadline. We compare Nezha with Multi-Paxos, Fast Paxos, Raft, a NOPaxos version we optimized for the cloud, and 2 recent protocols, Domino and TOQ-EPaxos, that use synchronized clocks. In throughput, Nezha outperforms all baselines by a median of 5.4x (range: 1.9-20.9x). In latency, Nezha outperforms five baselines by a median of 2.3x (range: 1.3-4.0x), with one exception: it sacrifices 33% latency compared with our optimized NOPaxos in one test. We also prototype two applications, a key-value store and a fair-access stock exchange, on top of Nezha to show that Nezha only modestly reduces their performance relative to an unreplicated system. Nezha is available at https://github.com/Steamgjk/Nezha.


title: Examining the Implementation of Digital Health to Strengthen the COVID-19 Pandemic Response and Recovery and Scale up Equitable Vaccine Access in African Countries

abstract: The COVID-19 pandemic has profoundly impacted the world, having taken the lives of over 6 million individuals. Accordingly, this pandemic has caused a shift in conversations surrounding the burden of diseases worldwide, welcoming insights from multidisciplinary fields including digital health and artificial intelligence. Africa faces a heavy disease burden that exacerbates the current COVID-19 pandemic and limits the scope of public health preparedness, response, containment, and case management. Herein, we examined the potential impact of transformative digital health technologies in mitigating the global health crisis with reference to African countries. Furthermore, we proposed recommendations for scaling up digital health technologies and artificial intelligence-based platforms to tackle the transmission of the SARS-CoV-2 and enable equitable vaccine access. Challenges related to the pandemic are numerous. Rapid response and management strategies - that is, contract tracing, case surveillance, diagnostic testing intensity, and most recently vaccine distribution mapping - can overwhelm the health care delivery system that is fragile. Although challenges are vast, digital health technologies can play an essential role in achieving sustainable resilient recovery and building back better. It is plausible that African nations are better equipped to rapidly identify, diagnose, and manage infected individuals for COVID-19, other diseases, future outbreaks, and pandemics.


title: NeMF: Neural Motion Fields for Kinematic Animation

abstract: We present an implicit neural representation to learn the spatio-temporal space of kinematic motions. Unlike previous work that represents motion as discrete sequential samples, we propose to express the vast motion space as a continuous function over time, hence the name Neural Motion Fields (NeMF). Specifically, we use a neural network to learn this function for miscellaneous sets of motions, which is designed to be a generative model conditioned on a temporal coordinate $t$ and a random vector $z$ for controlling the style. The model is then trained as a Variational Autoencoder (VAE) with motion encoders to sample the latent space. We train our model with a diverse human motion dataset and quadruped dataset to prove its versatility, and finally deploy it as a generic motion prior to solve task-agnostic problems and show its superiority in different motion generation and editing applications, such as motion interpolation, in-betweening, and re-navigating. More details can be found on our project page: https://cs.yale.edu/homes/che/projects/nemf/.


title: Collaborative Intelligence Orchestration: Inconsistency-Based Fusion of Semi-Supervised Learning and Active Learning

abstract: While annotating decent amounts of data to satisfy sophisticated learning models can be cost-prohibitive for many real-world applications. Active learning (AL) and semi-supervised learning (SSL) are two effective, but often isolated, means to alleviate the data-hungry problem. Some recent studies explored the potential of combining AL and SSL to better probe the unlabeled data. However, almost all these contemporary SSL-AL works use a simple combination strategy, ignoring SSL and AL's inherent relation. Further, other methods suffer from high computational costs when dealing with large-scale, high-dimensional datasets. Motivated by the industry practice of labeling data, we propose an innovative Inconsistency-based virtual aDvErsarial Active Learning (IDEAL) algorithm to further investigate SSL-AL's potential superiority and achieve mutual enhancement of AL and SSL, i.e., SSL propagates label information to unlabeled samples and provides smoothed embeddings for AL, while AL excludes samples with inconsistent predictions and considerable uncertainty for SSL. We estimate unlabeled samples' inconsistency by augmentation strategies of different granularities, including fine-grained continuous perturbation exploration and coarse-grained data transformations. Extensive experiments, in both text and image domains, validate the effectiveness of the proposed algorithm, comparing it against state-of-the-art baselines. Two real-world case studies visualize the practical industrial value of applying and deploying the proposed data sampling algorithm.