title: Mapping Machine-Learned Physics into a Human-Readable Space

abstract: We present a technique for translating a black-box machine-learned classifier operating on a high-dimensional input space into a small set of human-interpretable observables that can be combined to make the same classification decisions. We iteratively select these observables from a large space of high-level discriminants by finding those with the highest decision similarity relative to the black box, quantified via a metric we introduce that evaluates the relative ordering of pairs of inputs. Successive iterations focus only on the subset of input pairs that are misordered by the current set of observables. This method enables simplification of the machine-learning strategy, interpretation of the results in terms of well-understood physical concepts, validation of the physical model, and the potential for new insights into the nature of the problem itself. As a demonstration, we apply our approach to the benchmark task of jet classification in collider physics, where a convolutional neural network acting on calorimeter jet images outperforms a set of six well-known jet substructure observables. Our method maps the convolutional neural network into a set of observables called energy flow polynomials, and it closes the performance gap by identifying a class of observables with an interesting physical interpretation that has been previously overlooked in the jet substructure literature.


title: Exploring the Impact of Affine Loop Transformations in Qubit Allocation

abstract: Most quantum compiler transformations and qubit allocation techniques to date are either peep-hole focused or rely on sliding windows that depend on a number of external parameters. Thus, global optimization criteria are still lacking. In this paper we explore the synergies and impact of affine loop transformations in the context of qubit allocation and mapping. With this goal in mind, we have implemented a domain specific language and source-to-source compiler for quantum circuits that can be directly described with affine relations. We conduct an extensive evaluation spanning 8 quantum circuits taken from the literature, 3 distinct coupling graphs, 4 affine transformations (including the Pluto dependence distance minimization and Feautrier's minimum latency algorithms), and 4 qubit allocators. Our results demonstrate that affine transformations using global optimization criteria can cooperate effectively in several scenarios with quantum qubit mapping algorithms to reduce the circuit depth, size and allocation time.


title: Computationally and Statistically Efficient Truncated Regression

abstract: We provide a computationally and statistically efficient estimator for the classical problem of truncated linear regression, where the dependent variable $y = w^T x + \epsilon$ and its corresponding vector of covariates $x \in R^k$ are only revealed if the dependent variable falls in some subset $S \subseteq R$; otherwise the existence of the pair $(x, y)$ is hidden. This problem has remained a challenge since the early works of [Tobin 1958, Amemiya 1973, Hausman and Wise 1977], its applications are abundant, and its history dates back even further to the work of Galton, Pearson, Lee, and Fisher. While consistent estimators of the regression coefficients have been identified, the error rates are not well-understood, especially in high dimensions. Under a thickness assumption about the covariance matrix of the covariates in the revealed sample, we provide a computationally efficient estimator for the coefficient vector $w$ from $n$ revealed samples that attains $l_2$ error $\tilde{O}(\sqrt{k/n})$. Our estimator uses Projected Stochastic Gradient Descent (PSGD) without replacement on the negative log-likelihood of the truncated sample. For the statistically efficient estimation we only need oracle access to the set $S$.In order to achieve computational efficiency we need to assume that $S$ is a union of a finite number of intervals but still can be complicated. PSGD without replacement must be restricted to an appropriately defined convex cone to guarantee that the negative log-likelihood is strongly convex, which in turn is established using concentration of matrices on variables with sub-exponential tails. We perform experiments on simulated data to illustrate the accuracy of our estimator. As a corollary, we show that SGD learns the parameters of single-layer neural networks with noisy activation functions.


title: Reinforcement Learning with Combinatorial Actions: An Application to Vehicle Routing

abstract: Value-function-based methods have long played an important role in reinforcement learning. However, finding the best next action given a value function of arbitrary complexity is nontrivial when the action space is too large for enumeration. We develop a framework for value-function-based deep reinforcement learning with a combinatorial action space, in which the action selection problem is explicitly formulated as a mixed-integer optimization problem. As a motivating example, we present an application of this framework to the capacitated vehicle routing problem (CVRP), a combinatorial optimization problem in which a set of locations must be covered by a single vehicle with limited capacity. On each instance, we model an action as the construction of a single route, and consider a deterministic policy which is improved through a simple policy iteration algorithm. Our approach is competitive with other reinforcement learning methods and achieves an average gap of 1.7% with state-of-the-art OR methods on standard library instances of medium size.


title: On the impact of publicly available news and information transfer to financial markets

abstract: We quantify the propagation and absorption of large-scale publicly available news articles from the World Wide Web to financial markets. To extract publicly available information, we use the news archives from the Common Crawl, a nonprofit organization that crawls a large part of the web. We develop a processing pipeline to identify news articles associated with the constituent companies in the S\&P 500 index, an equity market index that measures the stock performance of U.S. companies. Using machine learning techniques, we extract sentiment scores from the Common Crawl News data and employ tools from information theory to quantify the information transfer from public news articles to the U.S. stock market. Furthermore, we analyze and quantify the economic significance of the news-based information with a simple sentiment-based portfolio trading strategy. Our findings provides support for that information in publicly available news on the World Wide Web has a statistically and economically significant impact on events in financial markets.


title: Sets with large intersection properties in metric spaces

abstract: In this work we reproduce the characterization of $\Gg^s$-sets from the euclidean setting [J. London Math. Soc. 49:267-280,1994] to more general metric spaces. These sets have Hausdorff dimension at least $s$ and are closed by countable intersections, which is particularly useful to estimate the dimension of the so called sets of $\alpha$-approximable points (that typically appear in Diophantine approximations).


title: Channel Estimation for Full-Duplex RIS-assisted HAPS Backhauling with Graph Attention Networks

abstract: In this paper, graph attention network (GAT) is firstly utilized for the channel estimation. In accordance with the 6G expectations, we consider a high-altitude platform station (HAPS) mounted reconfigurable intelligent surface-assisted two-way communications and obtain a low overhead and a high normalized mean square error performance. The performance of the proposed method is investigated on the two-way backhauling link over the RIS-integrated HAPS. The simulation results denote that the GAT estimator overperforms the least square in full-duplex channel estimation. Contrary to the previously introduced methods, GAT at one of the nodes can separately estimate the cascaded channel coefficients. Thus, there is no need to use time-division duplex mode during pilot signaling in full-duplex communication. Moreover, it is shown that the GAT estimator is robust to hardware imperfections and changes in small-scale fading characteristics even if the training data do not include all these variations.


title: Astrochemical Bistability: Autocatalysis in Oxygen Chemistry

abstract: The origin of bistable solutions in the kinetic equations describing the chemistry of dense interstellar clouds is explained as being due to the autocatalysis and feedback of oxygen nuclei from the oxygen dimer (O2). We identify four autocatalytic processes that can operate in dense molecular clouds, driven respectively by reactions of H+, He+, C+, and S+ with O2. We show that these processes can produce the bistable solutions found in previous studies, as well as the dependence on various model parameters such as the helium ionization rate, the sulfur depletion and the {{{H}}}3+ electron recombination rate. We also show that ion-grain neutralizations are unlikely to affect the occurrence of bistability in dense clouds. It is pointed out that many chemical models of astronomical sources should have the potential to show bistable solutions.


title: Micromobility Trip Origin and Destination Inference Using General Bikeshare Feed Specification (GBFS) Data

abstract: Emerging micromobility services (e.g., e-scooters) have a great potential to enhance urban mobility but more knowledge on their usage patterns is needed. The General Bikeshare Feed Specification (GBFS) data are a possible source for examining micromobility trip patterns, but efforts are needed to infer trips from the GBFS data. Existing trip inference methods are usually based upon the assumption that the vehicle ID of a micromobility option (e-scooter or e-bike) does not change, and so they cannot deal with data with vehicle IDs that change over time. In this study, we propose a comprehensive package of algorithms to infer trip origins and destinations from GBFS data with different types of vehicle ID. We implement the algorithms in Washington DC by analyzing one-week (last week of February 2020) of GBFS data published by six vendors, and we evaluate the inference accuracy of the proposed algorithms by R-squared, mean absolute error, and sum absolute error. We find that the R-squared measure is larger than 0.9 and the MAE measure is smaller than 2 when the algorithms are evaluated with a 400m*400m grid, and the absolute errors are relatively larger in the downtown area. The accuracy of the trip-inference algorithms is sufficiently high for most practical applications.


title: PRANK: motion Prediction based on RANKing

abstract: Predicting the motion of agents such as pedestrians or human-driven vehicles is one of the most critical problems in the autonomous driving domain. The overall safety of driving and the comfort of a passenger directly depend on its successful solution. The motion prediction problem also remains one of the most challenging problems in autonomous driving engineering, mainly due to high variance of the possible agent's future behavior given a situation. The two phenomena responsible for the said variance are the multimodality caused by the uncertainty of the agent's intent (e.g., turn right or move forward) and uncertainty in the realization of a given intent (e.g., which lane to turn into). To be useful within a real-time autonomous driving pipeline, a motion prediction system must provide efficient ways to describe and quantify this uncertainty, such as computing posterior modes and their probabilities or estimating density at the point corresponding to a given trajectory. It also should not put substantial density on physically impossible trajectories, as they can confuse the system processing the predictions. In this paper, we introduce the PRANK method, which satisfies these requirements. PRANK takes rasterized bird-eye images of agent's surroundings as an input and extracts features of the scene with a convolutional neural network. It then produces the conditional distribution of agent's trajectories plausible in the given scene. The key contribution of PRANK is a way to represent that distribution using nearest-neighbor methods in latent trajectory space, which allows for efficient inference in real time. We evaluate PRANK on the in-house and Argoverse datasets, where it shows competitive results.


title: Towards Zero-Shot Multilingual Synthetic Question and Answer Generation for Cross-Lingual Reading Comprehension

abstract: We propose a simple method to generate multilingual question and answer pairs on a large scale through the use of a single generative model. These synthetic samples can be used to improve the zero-shot performance of multilingual QA models on target languages. Our proposed multi-task training of the generative model only requires the labeled training samples in English, thus removing the need for such samples in the target languages, making it applicable to far more languages than those with labeled data. Human evaluations indicate the majority of such samples are grammatically correct and sensible. Experimental results show our proposed approach can achieve large gains on the XQuAD dataset, reducing the gap between zero-shot and supervised performance of smaller QA models on various languages.


title: The role of non-universal $Z$ couplings in explaining the $V_{us}$ anomaly

abstract: The tension among measurements of $V_{us}$ from different channels, the so-called Cabibbo Angle Anomaly, can be interpreted as a signal of lepton flavor universality (LFU) violation in the $W$ boson couplings. We investigate this issue in the framework of effective field theory, keeping the gauge structure of the Standard Model (SM) unchanged. We introduce gauge-invariant dimension-6 effective operators that couple the Higgs doublet to leptons, thereby giving non-universal tree-level contributions to the couplings of electroweak gauge bosons. Due to the $SU(2)_L$ gauge symmetry, a tension arises between the $V_{us}$ measurements that are affected by new $W$ couplings, and the electroweak precision measurements, which are also affected by the new $Z$ couplings. We show that this tension can be alleviated by allowing additional sources of gauge-invariant couplings of $Z$ boson to left- or right-handed leptons, and find the optimal regions indicated by the current data in the Wilson-coefficient space. We illustrate our model-independent results with the examples of minimal extensions of the SM involving the vector-like lepton (VLL) models. We point out that dimension-6 operators coupling the Higgs doublet to leptons can affect the rate of $h \to \tau \tau$ decay significantly in general, however this effect is restricted to less than a per cent level for the minimal VLL models.


title: Three Faces of the Aharonov-Bohm Phase

abstract: Beginning with the basic notions of quantum theory, impossibility of `trajectory' description for particles that ensues from uncertainty principle is discussed. Why the observed tracks in bubble/cloud chambers are not really the `trajectories' of high energy particles, rather they are simply the trails of the atoms/molecules excited or ionized in the direction of the high momenta of the incoming particles, are highlighted. Thereafter, the notion of symmetry and its application to the non-relativistic Schrodinger equation have been delineated. The demand for U(1) gauge invariance and the resulting `gauge miracle', that automatically leads to the correct interaction terms describing the electromagnetic force between the charge particles and the field, have been elaborated upon. A simple treatment, but with explicit derivation, of the Aharonov-Bohm effect, is presented, that underlines a strange phenomena - sites, impenetrable by charge particles but are threaded with magnetic field lines, conspire with a `Trojan Horse', namely the magnetic vector potential outside, to cause measurable shift in the double-slit interference fringes. This shift in the interference pattern is non-classical since the charge particles move in field-free regions. The crucial Aharonov-Bohm (AB) phase that makes its entry in the above bizarre effect is also deployed to derive the observed magnetic flux quantisation in superconductors as well as the Dirac result which implies that the existence of a single magnetic monopole anywhere in the universe would entail quantisation of the product of a particle's electric charge and the monopole's magnetic charge. Nontrivial consequences of AB phase follow whenever the physical region accessible, from the point of view of the wavefunction of a charge particle, is multiply-connected.


title: CellCycleGAN: Spatiotemporal Microscopy Image Synthesis of Cell Populations using Statistical Shape Models and Conditional GANs

abstract: Automatic analysis of spatio-temporal microscopy images is inevitable for state-of-the-art research in the life sciences. Recent developments in deep learning provide powerful tools for automatic analyses of such image data, but heavily depend on the amount and quality of provided training data to perform well. To this end, we developed a new method for realistic generation of synthetic 2D+t microscopy image data of fluorescently labeled cellular nuclei. The method combines spatiotemporal statistical shape models of different cell cycle stages with a conditional GAN to generate time series of cell populations and provides instance-level control of cell cycle stage and the fluorescence intensity of generated cells. We show the effect of the GAN conditioning and create a set of synthetic images that can be readily used for training and benchmarking of cell segmentation and tracking approaches.


title: Deep neural networks for collaborative learning analytics: Evaluating team collaborations using student gaze point prediction

abstract: Automatic assessment and evaluation of team performance during collaborative tasks is key to the learning analytics and computer-supported cooperative work research. There is a growing interest in the use of gaze-oriented cues for evaluating the collaboration and cooperativeness of teams. However, collecting gaze data using eye-trackers is not always feasible due to time and cost constraints. In this paper, we introduce an automated team assessment tool based on gaze points and joint visual attention (JVA) information extracted by computer vision solutions. We then evaluate team collaborations in an undergraduate anatomy learning activity (N=60, 30 teams) as a test user-study. The results indicate that higher JVA was positively associated with student learning outcomes (r(30)=0.50,p<0.005). Moreover, teams who participated in two experimental groups, and used interactive 3-D anatomy models, had higher JVA (F(1,28)=6.65,p<0.05) and better knowledge retention (F(1,28) =7.56,p<0.05) than those in the control group. Also, no significant difference was observed based on JVA for different gender compositions of teams. The findings from this work offer implications in learning sciences and collaborative computing by providing a novel mutual attention-based measure to objectively evaluate team collaboration dynamics.


title: Listening to Sounds of Silence for Speech Denoising

abstract: We introduce a deep learning model for speech denoising, a long-standing challenge in audio analysis arising in numerous applications. Our approach is based on a key observation about human speech: there is often a short pause between each sentence or word. In a recorded speech signal, those pauses introduce a series of time periods during which only noise is present. We leverage these incidental silent intervals to learn a model for automatic speech denoising given only mono-channel audio. Detected silent intervals over time expose not just pure noise but its time-varying features, allowing the model to learn noise dynamics and suppress it from the speech signal. Experiments on multiple datasets confirm the pivotal role of silent interval detection for speech denoising, and our method outperforms several state-of-the-art denoising methods, including those that accept only audio input (like ours) and those that denoise based on audiovisual input (and hence require more information). We also show that our method enjoys excellent generalization properties, such as denoising spoken languages not seen during training.


title: Spatiotemporal focusing through a multimode fiber via time-domain wavefront shaping

abstract: We shape fs optical pulses and deliver them in a single spatial mode to the input of a multimode fiber. The pulse is shaped in time such that at the output of the multimode fiber an ultrashort pulse appears at a predefined focus. Our result shows how to raster scan an ultrashort pulse at the output of a stiff piece of square-core step-index multimode fiber and in this way the potential for making a nonlinear fluorescent image of the scene behind the fiber, while the connection to the multimode fiber can be established via a thin and flexible single-mode fiber. The experimental results match our numerical simulation well.


title: Artificial Tikkun Olam: AI Can Be Our Best Friend in Building an Open Human-Computer Society

abstract: Technological advances of virtually every kind pose risks to society including fairness and bias. We review a long-standing wisdom that a widespread practical deployment of any technology may produce adverse side effects misusing the knowhow. This includes AI but AI systems are not solely responsible for societal risks. We describe some of the common and AI specific risks in health industries and other sectors and propose both broad and specific solutions. Each technology requires very specialized and informed tracking, monitoring and creative solutions. We postulate that AI systems are uniquely poised to produce conceptual and methodological solutions to both fairness and bias in automated decision-making systems. We propose a simple intelligent system quotient that may correspond to their adverse societal impact and outline a multi-tier architecture for producing solutions of increasing complexity to these risks. We also propose that universities may consider forming interdisciplinary Study of Future Technology Centers to investigate and predict the fuller range of risks posed by technology and seek both common and AI specific solutions using computational, technical, conceptual and ethical analysis


title: Towards falsifiable interpretability research

abstract: Methods for understanding the decisions of and mechanisms underlying deep neural networks (DNNs) typically rely on building intuition by emphasizing sensory or semantic features of individual examples. For instance, methods aim to visualize the components of an input which are "important" to a network's decision, or to measure the semantic properties of single neurons. Here, we argue that interpretability research suffers from an over-reliance on intuition-based approaches that risk-and in some cases have caused-illusory progress and misleading conclusions. We identify a set of limitations that we argue impede meaningful progress in interpretability research, and examine two popular classes of interpretability methods-saliency and single-neuron-based approaches-that serve as case studies for how overreliance on intuition and lack of falsifiability can undermine interpretability research. To address these concerns, we propose a strategy to address these impediments in the form of a framework for strongly falsifiable interpretability research. We encourage researchers to use their intuitions as a starting point to develop and test clear, falsifiable hypotheses, and hope that our framework yields robust, evidence-based interpretability methods that generate meaningful advances in our understanding of DNNs.


title: Harnessing Ambient Sensing & Naturalistic Driving Systems to Understand Links Between Driving Volatility and Crash Propensity in School Zones: A generalized hierarchical mixed logit framework

abstract: With the advent of seemingly unstructured big data, and through seamless integration of computation and physical components, cyber-physical systems (CPS) provide an innovative way to enhance safety and resiliency of transport infrastructure. This study focuses on real world microscopic driving behavior and its relevance to school zone safety expanding the capability, usability, and safety of dynamic physical systems through data analytics. Driving behavior and school zone safety is a public health concern. The sequence of instantaneous driving decisions and its variations prior to involvement in safety critical events, defined as driving volatility, can be a leading indicator of safety. By harnessing unique naturalistic data on more than 41,000 normal, crash, and near-crash events featuring over 9.4 million temporal samples of real-world driving, a characterization of volatility in microscopic driving decisions is sought at school and non-school zone locations. A big data analytic methodology is proposed for quantifying driving volatility in microscopic real-world driving decisions. Eight different volatility measures are then linked with detailed event specific characteristics, health history, driving history, experience, and other factors to examine crash propensity at school zones. A comprehensive yet fully flexible state-of-the-art generalized mixed logit framework is employed to fully account for distinct yet related methodological issues of scale and random heterogeneity, containing multinomial logit, random parameter logit, scaled logit, hierarchical scaled logit, and hierarchical generalized mixed logit as special cases. The results reveal that both for school and non-school locations, drivers exhibited greater intentional volatility prior to safety-critical events... ...


title: Patchworking Oriented Matroids

abstract: In a previous work, we gave a construction of (not necessarily realizable) oriented matroids from a triangulation of a product of two simplices. In this follow-up paper, we use a variant of Viro's patchworking to derive a topological representation of the oriented matroid directly from the polyhedral structure of the triangulation, hence finding a combinatorial manifestation of patchworking besides tropical algebraic geometry. We achieve this by rephrasing the patchworking procedure as a controlled cell merging process, guided by the structure of tropical oriented matroids. A key insight is a new promising technique to show that the final cell complex is regular.


title: A New Charter of Ethics and Rights of Artificial Consciousness in a Human World

abstract: Taking the stance that artificially conscious agents should be given human-like rights, in this paper we attempt to define consciousness, aggregate existing universal human rights, analyze robotic laws with roots in both reality and science fiction, and synthesize everything to create a new robot-ethical charter. By restricting the problem-space of possible levels of conscious beings to human-like, we succeed in developing a working definition of consciousness for social strong AI which focuses on human-like creativity being exhibited as a third-person observable phenomenon. Creativity is then extrapolated to represent first-person functionality, fulfilling the first/third-person feature of consciousness. Next, several sources of existing rights and rules, both for humans and robots, are analyzed and, along with supplementary informal reports, synthesized to create articles for an additive charter which compliments the United Nation's Universal Declaration of Human Rights. Finally, the charter is presented and the paper concludes with the conditions for amending the charter, as well as recommendations for further charters.


title: Africa 3: A Continental Network Model to Enable the African Fourth Industrial Revolution

abstract: It is widely recognised that collaboration can help fast-track the development of countries in Africa. Leveraging on the fourth industrial revolution, Africa can achieve accelerated development in health care services, educational systems and socio-economic infrastructures. While a number of conceptual frameworks have been proposed for the African continent, many have discounted the Cloud infrastructure used for data storage and processing, as well as the underlying network infrastructure upon which such frameworks would be built. This work therefore presents a continental network model for interconnecting nations in Africa through its data centres. The proposed model is based on a multilayer network engineering approach, which first groups African countries into clusters of data centres using a hybrid combination of clustering techniques; then utilizes Ant Colony Optimization with Stench Pheromone, that is modified to support variable evaporation rates, to find the ideal network path(s) across the clusters and the continent as a whole. The propsoed model takes into consideration the geo-spatial location, population sizes, data centre counts and intercontinental submarine cable landings of each African country, when clustering and routing. For bench-marking purposes, the path selection algorithm was tested on both the obtained clusters and African Union's regional clusters.


title: AutoPruning for Deep Neural Network with Dynamic Channel Masking

abstract: Modern deep neural network models are large and computationally intensive. One typical solution to this issue is model pruning. However, most current pruning algorithms depend on hand crafted rules or domain expertise. To overcome this problem, we propose a learning based auto pruning algorithm for deep neural network, which is inspired by recent automatic machine learning(AutoML). A two objectives' problem that aims for the the weights and the best channels for each layer is first formulated. An alternative optimization approach is then proposed to derive the optimal channel numbers and weights simultaneously. In the process of pruning, we utilize a searchable hyperparameter, remaining ratio, to denote the number of channels in each convolution layer, and then a dynamic masking process is proposed to describe the corresponding channel evolution. To control the trade-off between the accuracy of a model and the pruning ratio of floating point operations, a novel loss function is further introduced. Preliminary experimental results on benchmark datasets demonstrate that our scheme achieves competitive results for neural network pruning.


title: Saudi Arabian Parents' Perception of Online Marital Matchmaking Technologies

abstract: Finding a date or a spouse online is usually considered an individualistic endeavor in Western cultures. This presents a challenge for collectivist non-Western cultures such as Saudi Arabia where choosing a spouse is viewed as a union of two families with parents of both spouses being heavily involved. Our work aims to investigate how Saudi Arabian parents view the utilization of technology by their young adults to seek potential spouses online. We report our findings of interviews conducted with 16 Saudi Arabian parents (8 fathers, 6 mothers and 1 couple). We generate qualitative themes that provide insights about how parents wanted to preserve their values, integrate technology into the traditional process and protect their young adults from potential harms. These themes lead to implications for designing suitable marital matchmaking technologies in Saudi Arabia and opportunities for future work.


title: Comprehensive Attention Self-Distillation for Weakly-Supervised Object Detection

abstract: Weakly Supervised Object Detection (WSOD) has emerged as an effective tool to train object detectors using only the image-level category labels. However, without object-level labels, WSOD detectors are prone to detect bounding boxes on salient objects, clustered objects and discriminative object parts. Moreover, the image-level category labels do not enforce consistent object detection across different transformations of the same images. To address the above issues, we propose a Comprehensive Attention Self-Distillation (CASD) training approach for WSOD. To balance feature learning among all object instances, CASD computes the comprehensive attention aggregated from multiple transformations and feature layers of the same images. To enforce consistent spatial supervision on objects, CASD conducts self-distillation on the WSOD networks, such that the comprehensive attention is approximated simultaneously by multiple transformations and feature layers of the same images. CASD produces new state-of-the-art WSOD results on standard benchmarks such as PASCAL VOC 2007/2012 and MS-COCO.


title: Sequence-to-sequence Singing Voice Synthesis with Perceptual Entropy Loss

abstract: The neural network (NN) based singing voice synthesis (SVS) systems require sufficient data to train well and are prone to over-fitting due to data scarcity. However, we often encounter data limitation problem in building SVS systems because of high data acquisition and annotation costs. In this work, we propose a Perceptual Entropy (PE) loss derived from a psycho-acoustic hearing model to regularize the network. With a one-hour open-source singing voice database, we explore the impact of the PE loss on various mainstream sequence-to-sequence models, including the RNN-based, transformer-based, and conformer-based models. Our experiments show that the PE loss can mitigate the over-fitting problem and significantly improve the synthesized singing quality reflected in objective and subjective evaluations.


title: Combination of Deep Speaker Embeddings for Diarisation

abstract: Significant progress has recently been made in speaker diarisation after the introduction of d-vectors as speaker embeddings extracted from neural network (NN) speaker classifiers for clustering speech segments. To extract better-performing and more robust speaker embeddings, this paper proposes a c-vector method by combining multiple sets of complementary d-vectors derived from systems with different NN components. Three structures are used to implement the c-vectors, namely 2D self-attentive, gated additive, and bilinear pooling structures, relying on attention mechanisms, a gating mechanism, and a low-rank bilinear pooling mechanism respectively. Furthermore, a neural-based single-pass speaker diarisation pipeline is also proposed in this paper, which uses NNs to achieve voice activity detection, speaker change point detection, and speaker embedding extraction. Experiments and detailed analyses are conducted on the challenging AMI and NIST RT05 datasets which consist of real meetings with 4--10 speakers and a wide range of acoustic conditions. For systems trained on the AMI training set, relative speaker error rate (SER) reductions of 13% and 29% are obtained by using c-vectors instead of d-vectors on the AMI dev and eval sets respectively, and a relative reduction of 15% in SER is observed on RT05, which shows the robustness of the proposed methods. By incorporating VoxCeleb data into the training set, the best c-vector system achieved 7%, 17% and16% relative SER reduction compared to the d-vector on the AMI dev, eval, and RT05 sets respectively


title: "Healthy surveillance": Designing a concept for privacy-preserving mask recognition AI in the age of pandemics

abstract: The obligation to wear masks in times of pandemics reduces the risk of spreading viruses. In case of the COVID-19 pandemic in 2020, many governments recommended or even obligated their citizens to wear masks as an effective countermeasure. In order to continuously monitor the compliance of this policy measure in public spaces like restaurants or tram stations by public authorities, one scalable and automatable option depicts the application of surveillance systems, i.e., CCTV. However, large-scale monitoring of mask recognition does not only require a well-performing Artificial Intelligence, but also ensure that no privacy issues are introduced, as surveillance is a deterrent for citizens and regulations like General Data Protection Regulation (GDPR) demand strict regulations of such personal data. In this work, we show how a privacy-preserving mask recognition artifact could look like, demonstrate different options for implementation and evaluate performances. Our conceptual deep-learning based Artificial Intelligence is able to achieve detection performances between 95% and 99% in a privacy-friendly setting. On that basis, we elaborate on the trade-off between the level of privacy preservation and Artificial Intelligence performance, i.e. the "price of privacy".


title: Predicting future state for adaptive clinical pathway management

abstract: Clinical decision support systems are assisting physicians in providing care to patients. However, in the context of clinical pathway management such systems are rather limited as they only take the current state of the patient into account and ignore the possible evolvement of that state in the future. In the past decade, the availability of big data in the healthcare domain did open a new era for clinical decision support. Machine learning technologies are now widely used in the clinical domain, nevertheless, mostly as a tool for disease prediction. A tool that not only predicts future states, but also enables adaptive clinical pathway management based on these predictions is still in need. This paper introduces weighted state transition logic, a logic to model state changes based on actions planned in clinical pathways. Weighted state transition logic extends linear logic by taking weights -- numerical values indicating the quality of an action or an entire clinical pathway -- into account. It allows us to predict the future states of a patient and it enables adaptive clinical pathway management based on these predictions. We provide an implementation of weighted state transition logic using semantic web technologies, which makes it easy to integrate semantic data and rules as background knowledge. Executed by a semantic reasoner, it is possible to generate a clinical pathway towards a target state, as well as to detect potential conflicts in the future when multiple pathways are coexisting. The transitions from the current state to the predicted future state are traceable, which builds trust from human users on the generated pathway.


title: Packable hyperbolic surfaces with symmetries

abstract: We discuss several ways of packing a hyperbolic surface with circles (of either varying radii or all being congruent) or horocycles, and note down some observations related to their symmetries (or the absence thereof).


title: A monoidal analogue of the 2-category anti-equivalence between ABEX and DEF

abstract: We prove that the 2-category of skeletally small abelian categories with exact monoidal structures is anti-equivalent to the 2-category of fp-hom-closed definable additive categories satisfying an exactness criterion. For a fixed finitely accessible category $\mathcal{C}$ with products and a monoidal structure satisfying the appropriate assumptions, we provide bijections between the fp-hom-closed definable subcategories of $\mathcal{C}$, the Serre tensor-ideals of $\mathcal{C}^{\mathrm{fp}}\hbox{-}\mathrm{mod}$ and the closed subsets of a Ziegler-type topology. For a skeletally small preadditive category $\mathcal{A}$ with an additive, symmetric, rigid monoidal structure we show that elementary duality induces a bijection between the fp-hom-closed definable subcategories of $\mathrm{Mod}\hbox{-}\mathcal{A}$ and the definable tensor-ideals of $\mathcal{A}\hbox{-}\mathrm{Mod}$.


title: Automating Abnormality Detection in Musculoskeletal Radiographs through Deep Learning

abstract: This paper introduces MuRAD (Musculoskeletal Radiograph Abnormality Detection tool), a tool that can help radiologists automate the detection of abnormalities in musculoskeletal radiographs (bone X-rays). MuRAD utilizes a Convolutional Neural Network (CNN) that can accurately predict whether a bone X-ray is abnormal, and leverages Class Activation Map (CAM) to localize the abnormality in the image. MuRAD achieves an F1 score of 0.822 and a Cohen's kappa of 0.699, which is comparable to the performance of expert radiologists.


title: Theoretical opportunities for rural innovation and entrepreneurship research

abstract: Even though rural entrepreneurship and innovation has been studied for decades, the advent of social media, mobile, analytics, cloud computing and internet of things - also referred as digital technologies - (Nambisan 2013, Yoo et al. 2012) has provided new opportunities and challenges for this vast discipline. As a result, we see new business models, new processes, products and services offered using new digital technologies. Such changes challenge the orthodox view of IT entrepreneurship and innovation, opening new avenues for researches and challenges the existing theoretical understanding. This book chapter is an attempt to understand the existing literature on rural innovation and entrepreneurship in information systems discipline and identify opportunities for rural entrepreneurship and innovation in the digital era.


title: Flaws in Flawlessness: Perfectionism as a New Technology Driven Mental Disorder

abstract: Today, technologies, devices and systems play a major role in our lives. Anecdotal commentary suggests that such technologies and our interactions with them create a false sense of perfectionism about life, events and its outcomes. While it is admirable to strive for better outcomes, constant and sometimes unrealistic expectations create a psychological condition commonly known as Perfectionism, the fear of not doing something right or the fear of not being good enough. In this paper, based on the Diagnostic Statistical Manual of Mental Disorders (DSM-III), we conceptualize digital perfectionism as an emerging disorder, that is specific to our increasing interactions with tools and technologies. By using a sample of 336 individuals, this study makes valuable early insights on digital perfectionism, its conceptualization and its effects on the individuals.


title: Regret Bounds without Lipschitz Continuity: Online Learning with Relative-Lipschitz Losses

abstract: In online convex optimization (OCO), Lipschitz continuity of the functions is commonly assumed in order to obtain sublinear regret. Moreover, many algorithms have only logarithmic regret when these functions are also strongly convex. Recently, researchers from convex optimization proposed the notions of "relative Lipschitz continuity" and "relative strong convexity". Both of the notions are generalizations of their classical counterparts. It has been shown that subgradient methods in the relative setting have performance analogous to their performance in the classical setting. In this work, we consider OCO for relative Lipschitz and relative strongly convex functions. We extend the known regret bounds for classical OCO algorithms to the relative setting. Specifically, we show regret bounds for the follow the regularized leader algorithms and a variant of online mirror descent. Due to the generality of these methods, these results yield regret bounds for a wide variety of OCO algorithms. Furthermore, we further extend the results to algorithms with extra regularization such as regularized dual averaging.


title: Digital Transformation: Environmental Friend or Foe? Panel Discussion at the Australasian Conference on Information Systems 2019

abstract: The advent of digital technologies such as social media, mobile, analytics, cloud computing and internet-of-things has provided unique opportunities for organizations to engage in innovations that are affordable, easy-to-use, easy-to-learn and easy-to-implement. Transformations through such technologies often have positive impacts on business processes, products and services. As such, organizations have managed to increase productivity and efficiency, reduce cycle time and make substantial gains through digital transformation. Such transformations have also been positively associated with reducing harmful environmental impacts by providing organizations alternative ways of undertaking their business activities. However, in recent times, especially with an abundance of technologies being available at near-zero costs, questions regarding the potential negative impacts of digital transformation on the environment have arisen. The morass of the ubiquitous technologies around us necessitates the continuing creation of large data centers, that are increasing their capacity yielding a negative impact on the environment. Considering this dialectical contradiction, a panel was conducted at the Australasian Conference on Information Systems (ACIS) in Perth, Australia, in 2019. Its aim was to invigorate the dialogue regarding the impact of digital transformation on environmental sustainability and suggested some directions for future research in this area.


title: Keep your Eyes on the Lane: Real-time Attention-guided Lane Detection

abstract: Modern lane detection methods have achieved remarkable performances in complex real-world scenarios, but many have issues maintaining real-time efficiency, which is important for autonomous vehicles. In this work, we propose LaneATT: an anchor-based deep lane detection model, which, akin to other generic deep object detectors, uses the anchors for the feature pooling step. Since lanes follow a regular pattern and are highly correlated, we hypothesize that in some cases global information may be crucial to infer their positions, especially in conditions such as occlusion, missing lane markers, and others. Thus, this work proposes a novel anchor-based attention mechanism that aggregates global information. The model was evaluated extensively on three of the most widely used datasets in the literature. The results show that our method outperforms the current state-of-the-art methods showing both higher efficacy and efficiency. Moreover, an ablation study is performed along with a discussion on efficiency trade-off options that are useful in practice.


title: National Access Points for Intelligent Transport Systems Data: From Conceptualization to Benefits Recognition and Exploitation

abstract: Intelligent Transport Systems (ITS) constitute a core representative of a paradigm shift in the transport sector. The extent to which the transport sector has adapted itself to this digital era relies considerably on the availability of suitable and reliable data. Currently, several data-related limitations, such as the scarcity of available datasets, hinder the deployment of ITS services. Such limitations may be overcome with the deployment of properly designed data exchange platforms that enable a seamless life-cycle of data harvesting, processing, and sharing. The European Union recognizing the potential benefits of such platforms has, through the relevant Delegated Regulations, proposed the development of a National Access Point (NAP) by each individual Member State. This paper aims to ascertain the role of a NAP within the ITS ecosystem, to investigate methodologies used in designing such platforms, and, through the drafting of an extended use case, showcase a NAP operational process and associate possible benefits with specific steps of it.


title: Training Opportunities for Intelligent Transport Systems and Cooperative Intelligent Transport Systems

abstract: Intelligent Transport Systems (ITS) and Cooperative Intelligent Transport Systems (C-ITS) are of high significance, mainly due to the benefits they have in terms of operation of the transport network. Despite ITS and C-ITS importance in the operation of the transport network, there is a major knowledge gap regarding their development, way of operation and significance worldwide and especially among the responsible for their deployment public authorities. In order for such fragmentations to be tackled, an online training platform concerning the operation and impacts of ITS and C-ITS has been designed in the framework of the European Union Horizon 2020 funded CAPITAL project. In order for the proper design of the CAPITAL Online Training Platform, two main approaches have been studied: capacity building and massive open online courses. The present study provides insight regarding the design and the context of the CAPITAL Online Training Platform.


title: Supporting Tool for The Transition of Existing Small and Medium Enterprises Towards Industry 4.0

abstract: The rapid growth of Industry 4.0 technologies such as big data, cloud computing, smart sensors, machine learning (ML), radio-frequency identification (RFID), robotics, 3D-printing, and Internet of Things (IoT) offers Small and Medium Enterprises (SMEs) the chance to improve productivity and efficiency, reduce cost and provide better customer experience, among other benefits. The main purpose of this work is to propose a methodology to support SMEs managers in better understanding the specific requirements for the implementation of Industry 4.0 solutions and the derived benefits within their firms. A proposed methodology will be helpful for SMEs manager to take a decision regarding when and how to migrate to Industry 4.0.


title: Reducing Adversarially Robust Learning to Non-Robust PAC Learning

abstract: We study the problem of reducing adversarially robust learning to standard PAC learning, i.e. the complexity of learning adversarially robust predictors using access to only a black-box non-robust learner. We give a reduction that can robustly learn any hypothesis class $\mathcal{C}$ using any non-robust learner $\mathcal{A}$ for $\mathcal{C}$. The number of calls to $\mathcal{A}$ depends logarithmically on the number of allowed adversarial perturbations per example, and we give a lower bound showing this is unavoidable.


title: Flattening the COVID-19 Curve: The "Greek" case in the Global Pandemic

abstract: The global crisis caused by the COVID-19 pandemic, in conjunction with the economic consequences and the collapse of health systems, has raised serious concerns in Europe, which is the most affected continent by the pandemic since it recorded 2,388,694 cases and 190,091 deaths (39.6% of the worldwide total), of which 71.7% (136,238) are in the United Kingdom (43,414), Italy (34,708), France (29,778), and Spain (28,338). Unlike other countries, Greece, with about 310 confirmed cases and 18 deaths per million, is one bright exception in the study and analysis of this phenomenon. Focusing on the peculiarities of the disease spreading in Greece, both in epidemiological and in implementation terms, this paper applies an exploratory analysis of COVID-19 temporal spread in Greece and proposes a methodological approach for the modeling and prediction of the disease based on the Regression Splines algorithm and the change rate of the total infections. Also, it proposes a hybrid spline regression and complex network model of social distance measures evaluating and interpreting the spread of the disease. The overall approach contributes to decision making and support of the public health system and to the fight against the pandemic.


title: Deep image prior for undersampling high-speed photoacoustic microscopy

abstract: Photoacoustic microscopy (PAM) is an emerging imaging method combining light and sound. However, limited by the laser's repetition rate, state-of-the-art high-speed PAM technology often sacrifices spatial sampling density (i.e., undersampling) for increased imaging speed over a large field-of-view. Deep learning (DL) methods have recently been used to improve sparsely sampled PAM images; however, these methods often require time-consuming pre-training and large training dataset with ground truth. Here, we propose the use of deep image prior (DIP) to improve the image quality of undersampled PAM images. Unlike other DL approaches, DIP requires neither pre-training nor fully-sampled ground truth, enabling its flexible and fast implementation on various imaging targets. Our results have demonstrated substantial improvement in PAM images with as few as 1.4$\%$ of the fully sampled pixels on high-speed PAM. Our approach outperforms interpolation, is competitive with pre-trained supervised DL method, and is readily translated to other high-speed, undersampling imaging modalities.


title: SAINT+: Integrating Temporal Features for EdNet Correctness Prediction

abstract: We propose SAINT+, a successor of SAINT which is a Transformer based knowledge tracing model that separately processes exercise information and student response information. Following the architecture of SAINT, SAINT+ has an encoder-decoder structure where the encoder applies self-attention layers to a stream of exercise embeddings, and the decoder alternately applies self-attention layers and encoder-decoder attention layers to streams of response embeddings and encoder output. Moreover, SAINT+ incorporates two temporal feature embeddings into the response embeddings: elapsed time, the time taken for a student to answer, and lag time, the time interval between adjacent learning activities. We empirically evaluate the effectiveness of SAINT+ on EdNet, the largest publicly available benchmark dataset in the education domain. Experimental results show that SAINT+ achieves state-of-the-art performance in knowledge tracing with an improvement of 1.25% in area under receiver operating characteristic curve compared to SAINT, the current state-of-the-art model in EdNet dataset.


title: Trade-offs and synergies in managing coastal flood risk: A case study for New York City

abstract: Decisions on how to manage future flood risks are frequently informed by both sophisticated and computationally expensive models. This complexity often limits the representation of uncertainties and the consideration of strategies. Here, we use an intermediate complexity model framework that enables us to analyze a rich set of strategies, objectives, and uncertainties. We find that allowing for more combinations of risk mitigation strategies can expand the solution set, help explain synergies and trade-offs, and point to strategies that can improve outcomes.


title: Severe Dirac Mass Gap Suppression in Sb_2Te_3-based Quantum Anomalous Hall Materials

abstract: Quantum anomalous Hall (QAH) effect appears in ferromagnetic topological insulators (FMTI) when a Dirac mass gap opens in the spectrum of the topological surface states (SS). Unaccountably, although the mean mass gap can exceed 28 meV (or ~320 K), the QAH effect is frequently only detectable at temperatures below 1 K. Using atomic-resolution Landau level spectroscopic imaging, we compare the electronic structure of the archetypal FMTI Cr_0.08(Bi_0.1Sb_0.9)_1.92Te_3 to that of its non-magnetic parent (Bi_0.1Sb_0.9)_2Te_3, to explore the cause. In (Bi_0.1Sb_0.9)_2Te_3, we find spatially random variations of the Dirac energy. Statistically equivalent Dirac energy variations are detected in Cr_0.08(Bi_0.1Sb_0.9)_1.92Te_3 with concurrent but uncorrelated Dirac mass gap disorder. These two classes of SS electronic disorder conspire to drastically suppress the minimum mass gap to below 100 {\mu}eV for nanoscale regions separated by <1 {\mu}m. This fundamentally limits the fully quantized anomalous Hall effect in Sb_2Te_3-based FMTI materials to very low temperatures.


title: On the Schr\"{o}dinger map for regular helical polygons in the hyperbolic space

abstract: The main purpose is to describe the evolution of $\Xt = \Xs \wedge_- \Xss,$ with $\X(s,0)$ a regular polygonal curve with a nonzero torsion in the 3-dimensional hyperbolic space. Unlike in the Euclidean space, a nonzero torsion implies two different helical curves. However, recent techniques developed by de la Hoz, Kumar, and Vega help us in describing the evolution at rational times both theoretically and numerically, and thus, the similarities and differences. Numerical experiments show that the trajectory of the point $\X(0,t)$ exhibits new variants of Riemann's non-differentiable function whose structure depends on the initial torsion in the problem. As a result, with these new solutions, it is shown that the smooth solutions (helices, straight line) in the hyperbolic space show the same instability as displayed by their Euclidean counterparts and curves with zero-torsion. These numerical observations are in agreement with some recent theoretical results obtained by Banica and Vega.


title: Using Deep Image Priors to Generate Counterfactual Explanations

abstract: Through the use of carefully tailored convolutional neural network architectures, a deep image prior (DIP) can be used to obtain pre-images from latent representation encodings. Though DIP inversion has been known to be superior to conventional regularized inversion strategies such as total variation, such an over-parameterized generator is able to effectively reconstruct even images that are not in the original data distribution. This limitation makes it challenging to utilize such priors for tasks such as counterfactual reasoning, wherein the goal is to generate small, interpretable changes to an image that systematically leads to changes in the model prediction. To this end, we propose a novel regularization strategy based on an auxiliary loss estimator jointly trained with the predictor, which efficiently guides the prior to recover natural pre-images. Our empirical studies with a real-world ISIC skin lesion detection problem clearly evidence the effectiveness of the proposed approach in synthesizing meaningful counterfactuals. In comparison, we find that the standard DIP inversion often proposes visually imperceptible perturbations to irrelevant parts of the image, thus providing no additional insights into the model behavior.


title: Fading memory echo state networks are universal

abstract: Echo state networks (ESNs) have been recently proved to be universal approximants for input/output systems with respect to various $L ^p$-type criteria. When $1\leq p< \infty$, only $p$-integrability hypotheses need to be imposed, while in the case $p=\infty$ a uniform boundedness hypotheses on the inputs is required. This note shows that, in the last case, a universal family of ESNs can be constructed that contains exclusively elements that have the echo state and the fading memory properties. This conclusion could not be drawn with the results and methods available so far in the literature.


title: Factor Graph Grammars

abstract: We propose the use of hyperedge replacement graph grammars for factor graphs, or factor graph grammars (FGGs) for short. FGGs generate sets of factor graphs and can describe a more general class of models than plate notation, dynamic graphical models, case-factor diagrams, and sum-product networks can. Moreover, inference can be done on FGGs without enumerating all the generated factor graphs. For finite variable domains (but possibly infinite sets of graphs), a generalization of variable elimination to FGGs allows exact and tractable inference in many situations. For finite sets of graphs (but possibly infinite variable domains), a FGG can be converted to a single factor graph amenable to standard inference techniques.


title: Hot Plasma Flows and Oscillations in the Loop-top Region During the September 10 2017 X8.2 Solar Flare

abstract: In this study, we investigate motions in the hot plasma above the flare loops during the 2017 September 10 X8.2 flare event. We examine the region to the south of the main flare arcade, where there is data from the Interface Region Imaging Spectrograph (IRIS), and the Extreme ultraviolet Imaging Spectrometer (EIS) on Hinode. We find that there are initial blue shifts of 20--60 km/s observed in this region in the Fe XXI line in IRIS and the Fe XXIV line in EIS, and that the locations of these blue shifts move southward along the arcade over the course of about 10 min. The cadence of IRIS allows us to follow the evolution of these flows, and we find that at each location where there is an initial blue shift in the Fe XXIV line, there are damped oscillations in the Doppler velocity with periods of ~400 s. We conclude that these periods are independent of loop length, ruling out magnetoacoustic standing modes as a possible mechanism. Microwave observations from the Expanded Owens Valley Solar Array (EOVSA) indicate that there are non-thermal emissions in the region where the Doppler shifts are observed, indicating that accelerated particles are present. We suggest that the flows and oscillations are due to motions of the magnetic field that are caused by reconnection outflows disturbing the loop-top region.


title: Contrastive Learning with Adversarial Examples

abstract: Contrastive learning (CL) is a popular technique for self-supervised learning (SSL) of visual representations. It uses pairs of augmentations of unlabeled training examples to define a classification task for pretext learning of a deep embedding. Despite extensive works in augmentation procedures, prior works do not address the selection of challenging negative pairs, as images within a sampled batch are treated independently. This paper addresses the problem, by introducing a new family of adversarial examples for constrastive learning and using these examples to define a new adversarial training algorithm for SSL, denoted as CLAE. When compared to standard CL, the use of adversarial examples creates more challenging positive pairs and adversarial training produces harder negative pairs by accounting for all images in a batch during the optimization. CLAE is compatible with many CL methods in the literature. Experiments show that it improves the performance of several existing CL baselines on multiple datasets.


title: The dimensional reduction of linearized spin-2 theories invariant under transverse diffeomorphisms

abstract: Here we perform the Kaluza-Klein dimensional reduction from $D+1$ to $D$ dimensions of massless Lagrangians described by a symmetric rank-2 tensor and invariant under transverse differmorphisms (TDiff). They include the linearized Einstein-Hilbert theory, linearized unimodular gravity and scalar tensor models. We obtain simple expressions in terms of gauge invariant field combinations and show that unitarity is preserved in all cases. After fixing a gauge, the reduced model becomes a massive scalar tensor theory. We show that the diffeomorphism (Diff) symmetry, instead of TDiff, is a general feature of the massless sector of consistent massive scalar tensor models. We discuss some subtleties when eliminating St\"uckelberg fields directly at action level as gauge conditions. We also show that the reduced models all have a smooth massless limit. A non local connection between the massless sector of the scalar tensor theory and the pure tensor TDiff model leads to a parametrization of the non conserved source which naturally separates spin-0 and spin-2 contributions in the pure tensor theory. The case of curved backgrounds is also investigated. If we truncate the non minimal couplings to linear terms in the curvature, vector and scalar constraints require Einstein spaces as in the Diff and WTDiff (Weyl plus Diff) cases. We prove that our linearized massive scalar tensor models admit those curved background extensions.


title: Arc-flow approach for single batch-processing machine scheduling

abstract: We address the problem of scheduling jobs with non-identical sizes and distinct processing times on a single batch processing machine, aiming at minimizing the makespan. The extensive literature on this NP-hard problem mostly focuses on heuristics. Using an arc flow-based optimization approach, we construct an ingenious formulation that represents it as a problem of determining flows in graphs. The size of the formulation increases with the number of distinct sizes and processing times among the jobs, but it does not increase with the number of jobs, which makes it very effective to solve large instances to optimality, especially when multiple jobs have equal size and processing time. We compare our model to other models from the literature showing its clear superiority on benchmark instances, and proving optimality of random instances with up to 100 million jobs.


title: Topological Invariants of a Filling-Enforced Quantum Band Insulator

abstract: Traditional ionic/covalent compound insulators arise from a commensuration between electron count and system volume. On the other hand, conventional topological insulators, outside of quantum hall effect systems, do not typically display such a commensuration. Tnstead, they can undergo a phase transition to a trivial insulator that preserves the electron filling. Nevertheless, in some crystalline insulators, termed filling-enforced quantum band insulators (feQBIs), electron filling can dictate nontrivial topology in the insulating ground state. Currently, little is known about the relation between feQBIs and conventional topological invariants. In this work, we study such relations for a particularly interesting example of a half-filling feQBI that is realized in space group 106 with spinless electrons. We prove that any 4-band feQBI in space group 106 with filling 2 must have a nontrivial topological invariant, namely the $\mathbb{Z}_2$ glide invariant, and thus must have a quantized magnetoelectric polarizability $\theta=\pi$. We thus have found a three-dimensional example where electron filling and band topology are tied. Such a locking raises intriguing questions about the generality of the band-inversion paradigm in describing the transition between trivial and topological phases.


title: Extracellular Matrix regulates the morphodynamics of 3D migrating cancer cells

abstract: Cell shape is linked to cell function. The significance of cell morphodynamics, namely the temporal fluctuation of cell shape, is much less understood. Here we study the morphodynamics of MDA-MB-231 cells in type I collagen extracellular matrix (ECM). We systematically vary ECM physical properties by tuning collagen concentrations, alignment, and gelation temperatures. We find that morphodynamics of 3D migrating cells are externally controlled by ECM mechanics and internally modulated by Rho-signaling. We employ machine learning to classify cell shape into four different morphological phenotypes, each corresponding to a distinct migration mode. As a result, we map cell morphodynamics at mesoscale into the temporal evolution of morphological phenotypes. We characterize the mesoscale dynamics including occurrence probability, dwell time and transition matrix at varying ECM conditions, which demonstrate the complex phenotype landscape and optimal pathways for phenotype transitions. In light of the mesoscale dynamics, we show that 3D cancer cell motility is a hidden Markov process whereby the step size distributions of cell migration are coupled with simultaneous cell morphodynamics. We also show that morphological phenotype transitions facilitate cancer cells to navigate non-uniform ECM such as traversing the interface between matrices of two distinct microstructures. In conclusion, we demonstrate that 3D migrating cancer cells exhibit rich morphodynamics that is regulated by ECM mechanics, Rho-signaling, and is closely related with cell motility. Our results pave the way to the functional understanding and mechanical programming of cell morphodynamics for normal and malignant cells.


title: A Discrete Variational Recurrent Topic Model without the Reparametrization Trick

abstract: We show how to learn a neural topic model with discrete random variables---one that explicitly models each word's assigned topic---using neural variational inference that does not rely on stochastic backpropagation to handle the discrete variables. The model we utilize combines the expressive power of neural methods for representing sequences of text with the topic model's ability to capture global, thematic coherence. Using neural variational inference, we show improved perplexity and document understanding across multiple corpora. We examine the effect of prior parameters both on the model and variational parameters and demonstrate how our approach can compete and surpass a popular topic model implementation on an automatic measure of topic quality.


title: Efficient parallel CP decomposition with pairwise perturbation and multi-sweep dimension tree

abstract: CP tensor decomposition with alternating least squares (ALS) is dominated in cost by the matricized-tensor times Khatri-Rao product (MTTKRP) kernel that is necessary to set up the quadratic optimization subproblems. State-of-art parallel ALS implementations use dimension trees to avoid redundant computations across MTTKRPs within each ALS sweep. In this paper, we propose two new parallel algorithms to accelerate CP-ALS. We introduce the multi-sweep dimension tree (MSDT) algorithm, which requires the contraction between an order N input tensor and the first-contracted input matrix once every (N-1)/N sweeps. This algorithm reduces the leading order computational cost by a factor of 2(N-1)/N relative to the best previously known approach. In addition, we introduce a more communication-efficient approach to parallelizing an approximate CP-ALS algorithm, pairwise perturbation. This technique uses perturbative corrections to the subproblems rather than recomputing the contractions, and asymptotically accelerates ALS. Our benchmark results show that the per-sweep time achieves 1.25X speed-up for MSDT and 1.94X speed-up for pairwise perturbation compared to the state-of-art dimension trees running on 1024 processors on the Stampede2 supercomputer.


title: The theory of half derivators

abstract: We review the theory of derivators from the ground up, defining new classes of derivators which were originally motivated by derivator K-theory. We prove that many old arguments that relied on homotopical bicompleteness hold also for one-sided half derivators on arbitrary diagram categories. We end by defining the maximal domain for a K-theory of derivators generalising Waldhausen K-theory.


title: An overview of block Gram-Schmidt methods and their stability properties

abstract: Block Gram-Schmidt algorithms serve as essential kernels in many scientific computing applications, but for many commonly used variants, a rigorous treatment of their stability properties remains open. This work provides a comprehensive categorization of block Gram-Schmidt algorithms, particularly those used in Krylov subspace methods to build orthonormal bases one block vector at a time. Known stability results are assembled, and new results are summarized or conjectured for important communication-reducing variants. Additionally, new block versions of low-synchronization variants are derived, and their efficacy and stability are demonstrated for a wide range of challenging examples. Numerical examples are computed with a versatile MATLAB package hosted at https://github.com/katlund/BlockStab, and scripts for reproducing all results in the paper are provided. Block Gram-Schmidt implementations in popular software packages are discussed, along with a number of open problems. An appendix containing all algorithms type-set in a uniform fashion is provided.


title: Principled Interpolation in Normalizing Flows

abstract: Generative models based on normalizing flows are very successful in modeling complex data distributions using simpler ones. However, straightforward linear interpolations show unexpected side effects, as interpolation paths lie outside the area where samples are observed. This is caused by the standard choice of Gaussian base distributions and can be seen in the norms of the interpolated samples. This observation suggests that correcting the norm should generally result in better interpolations, but it is not clear how to correct the norm in an unambiguous way. In this paper, we solve this issue by enforcing a fixed norm and, hence, change the base distribution, to allow for a principled way of interpolation. Specifically, we use the Dirichlet and von Mises-Fisher base distributions. Our experimental results show superior performance in terms of bits per dimension, Fr\'echet Inception Distance (FID), and Kernel Inception Distance (KID) scores for interpolation, while maintaining the same generative performance.


title: Analysis of three dimensional potential problems in non-homogeneous media with physics-informed deep collocation method using material transfer learning and sensitivity analysis

abstract: In this work, we present a deep collocation method for three dimensional potential problems in nonhomogeneous media. This approach utilizes a physics informed neural network with material transfer learning reducing the solution of the nonhomogeneous partial differential equations to an optimization problem. We tested different cofigurations of the physics informed neural network including smooth activation functions, sampling methods for collocation points generation and combined optimizers. A material transfer learning technique is utilised for nonhomogeneous media with different material gradations and parameters, which enhance the generality and robustness of the proposed method. In order to identify the most influential parameters of the network configuration, we carried out a global sensitivity analysis. Finally, we provide a convergence proof of our DCM. The approach is validated through several benchmark problems, also testing different material variations.


title: Simple Neighborhood Representative Pre-processing Boosts Outlier Detectors

abstract: Over the decades, traditional outlier detectors have ignored the group-level factor when calculating outlier scores for objects in data by evaluating only the object-level factor, failing to capture the collective outliers. To mitigate this issue, we present a method called neighborhood representative (NR), which empowers all the existing outlier detectors to efficiently detect outliers, including collective outliers, while maintaining their computational integrity. It achieves this by selecting representative objects, scoring these objects, then applies the score of the representative objects to its collective objects. Without altering existing detectors, NR is compatible with existing detectors, while improving performance on real world datasets with +8% (0.72 to 0.78 AUC) relative to state-of-the-art outlier detectors.


title: Post-CMOS Compatible Aluminum Scandium Nitride/2D Channel Ferroelectric Field-Effect-Transistor

abstract: In 1963, Moll and Tarui suggested that the field-effect conductance of a semiconductor could be controlled by the remanent polarization of a ferroelectric (FE) material to create a ferroelectric field-effect transistor (FE-FET). However, subsequent efforts to produce a practical, compact FE-FET have been plagued by low retention and incompatibility with Complementary Metal Oxide Semiconductor (CMOS) process integration. These difficulties led to the development of trapped-charge based memory devices (also called floating gate or flash memory), and these are now the mainstream non-volatile memory (NVM) technology. Over the past two decades, advances in oxide FE materials have rejuvenated the field of ferroelectrics and made FE random access memories (FE-RAM) a commercial reality. Despite these advances, commercial FE-RAM based on lead zirconium titanate (PZT) has stalled at the 130 nm due to process challenges.The recent discovery of scandium doped aluminum nitride (AlScN) as a CMOS compatible ferroelectric presents new opportunities for direct memory integration with logic transistors due to the low temperature of AlScN deposition (approx. 350 C). This temperature is compatible with CMOS back end of line processes. Here, we present a FE-FET device composed of an AlScN FE dielectric layer integrated with a channel layer of a van der Waals two-dimensional (2D) semiconductor, MoS2. Our devices show an ON/OFF ratio ~ 10^6, concurrent with a normalized memory window of 0.3 V/nm. The devices also demonstrate stable, two-state memory retention for up to 10^4 seconds. Our simulations and experimental results suggest that the combination of AlScN and 2D semiconductors is nearly ideal for low power FE-FET memory. These results demonstrate a new approach in embedded memory and in-memory computing, and could even lead to effective neuromorphic computing architectures.


title: Explaining Neural Network Predictions for Functional Data Using Principal Component Analysis and Feature Importance

abstract: Optical spectral-temporal signatures extracted from videos of explosions provide information for identifying characteristics of the corresponding explosive devices. Currently, the identification is done using heuristic algorithms and direct subject matter expert review. An improvement in predictive performance may be obtained by using machine learning, but this application lends itself to high consequence national security decisions, so it is not only important to provide high accuracy but clear explanations for the predictions to garner confidence in the model. While much work has been done to develop explainability methods for machine learning models, not much of the work focuses on situations with input variables of the form of functional data such optical spectral-temporal signatures. We propose a procedure for explaining machine learning models fit using functional data that accounts for the functional nature the data. Our approach makes use of functional principal component analysis (fPCA) and permutation feature importance (PFI). fPCA is used to transform the functions to create uncorrelated functional principal components (fPCs). The model is trained using the fPCs as inputs, and PFI is applied to identify the fPCs important to the model for prediction. Visualizations are used to interpret the variability explained by the fPCs that are found to be important by PFI to determine the aspects of the functions that are important for prediction. We demonstrate the technique by explaining neural networks fit to explosion optical spectral-temporal signatures for predicting characteristics of the explosive devices.


title: Cloud Energy Micro-Moment Data Classification: A Platform Study

abstract: Energy efficiency is a crucial factor in the well-being of our planet. In parallel, Machine Learning (ML) plays an instrumental role in automating our lives and creating convenient workflows for enhancing behavior. So, analyzing energy behavior can help understand weak points and lay the path towards better interventions. Moving towards higher performance, cloud platforms can assist researchers in conducting classification trials that need high computational power. Under the larger umbrella of the Consumer Engagement Towards Energy Saving Behavior by means of Exploiting Micro Moments and Mobile Recommendation Systems (EM)3 framework, we aim to influence consumers behavioral change via improving their power consumption consciousness. In this paper, common cloud artificial intelligence platforms are benchmarked and compared for micro-moment classification. The Amazon Web Services, Google Cloud Platform, Google Colab, and Microsoft Azure Machine Learning are employed on simulated and real energy consumption datasets. The KNN, DNN, and SVM classifiers have been employed. Superb performance has been observed in the selected cloud platforms, showing relatively close performance. Yet, the nature of some algorithms limits the training performance.


title: A generalized deep learning model for multi-disease Chest X-Ray diagnostics

abstract: We investigate the generalizability of deep convolutional neural network (CNN) on the task of disease classification from chest x-rays collected over multiple sites. We systematically train the model using datasets from three independent sites with different patient populations: National Institute of Health (NIH), Stanford University Medical Centre (CheXpert), and Shifa International Hospital (SIH). We formulate a sequential training approach and demonstrate that the model produces generalized prediction performance using held out test sets from the three sites. Our model generalizes better when trained on multiple datasets, with the CheXpert-Shifa-NET model performing significantly better (p-values < 0.05) than the models trained on individual datasets for 3 out of the 4 distinct disease classes. The code for training the model will be made available open source at: www.github.com/link-to-code at the time of publication.


title: Learning Patterns in Imaginary Vowels for an Intelligent Brain Computer Interface (BCI) Design

abstract: Technology advancements made it easy to measure non-invasive and high-quality electroencephalograph (EEG) signals from human's brain. Hence, development of robust and high-performance AI algorithms becomes crucial to properly process the EEG signals and recognize the patterns, which lead to an appropriate control signal. Despite the advancements in processing the motor imagery EEG signals, the healthcare applications, such as emotion detection, are still in the early stages of AI design. In this paper, we propose a modular framework for the recognition of vowels as the AI part of a brain computer interface system. We carefully designed the modules to discriminate the English vowels given the raw EEG signals, and meanwhile avoid the typical issued with the data-poor environments like most of the healthcare applications. The proposed framework consists of appropriate signal segmentation, filtering, extraction of spectral features, reducing the dimensions by means of principle component analysis, and finally a multi-class classification by decision-tree-based support vector machine (DT-SVM). The performance of our framework was evaluated by a combination of test-set and resubstitution (also known as apparent) error rates. We provide the algorithms of the proposed framework to make it easy for future researchers and developers who want to follow the same workflow.


title: A Calculation Model for Estimating Effect of COVID-19 Contact-Confirming Application (COCOA) on Decreasing Infectors

abstract: As of 2020, COVID-19 is spreading in the world. In Japan, the Ministry of Health, Labor and Welfare developed COVID-19 Contact-Confirming Application (COCOA). The researches to examine the effect of COCOA are still not sufficient. We develop a mathematical model to examine the effect of COCOA and show examined result.


title: Negative specific heat of the Landau-quantized T-3 Dice lattice in the nondegenerate statistical regime

abstract: This work addresses the statistical thermodynamic features of a Landau-quantized T-3 Dice lattice in a normal magnetic field in the nondegenerate statistical regime. Our study includes analyses of the Grand Potential, magnetic moment, entropy and specific heat at constant volume, with explicit determination of their temperature and magnetic field dependencies. In this, we find that the specific heat at constant volume is negative in the nondegenerate regime, for the Landau-quantized Dice lattice.


title: Improving Policy-Constrained Kidney Exchange via Pre-Screening

abstract: In barter exchanges, participants swap goods with one another without exchanging money; exchanges are often facilitated by a central clearinghouse, with the goal of maximizing the aggregate quality (or number) of swaps. Barter exchanges are subject to many forms of uncertainty--in participant preferences, the feasibility and quality of various swaps, and so on. Our work is motivated by kidney exchange, a real-world barter market in which patients in need of a kidney transplant swap their willing living donors, in order to find a better match. Modern exchanges include 2- and 3-way swaps, making the kidney exchange clearing problem NP-hard. Planned transplants often fail for a variety of reasons--if the donor organ is refused by the recipient's medical team, or if the donor and recipient are found to be medically incompatible. Due to 2- and 3-way swaps, failed transplants can "cascade" through an exchange; one US-based exchange estimated that about 85% of planned transplants failed in 2019. Many optimization-based approaches have been designed to avoid these failures; however most exchanges cannot implement these methods due to legal and policy constraints. Instead we consider a setting where exchanges can query the preferences of certain donors and recipients--asking whether they would accept a particular transplant. We characterize this as a two-stage decision problem, in which the exchange program (a) queries a small number of transplants before committing to a matching, and (b) constructs a matching according to fixed policy. We show that selecting these edges is a challenging combinatorial problem, which is non-monotonic and non-submodular, in addition to being NP-hard. We propose both a greedy heuristic and a Monte Carlo tree search, which outperforms previous approaches, using experiments on both synthetic data and real kidney exchange data from the United Network for Organ Sharing.


title: Dynamics and Domain Randomized Gait Modulation with Bezier Curves for Sim-to-Real Legged Locomotion

abstract: We present a sim-to-real framework that uses dynamics and domain randomized offline reinforcement learning to enhance open-loop gaits for legged robots, allowing them to traverse uneven terrain without sensing foot impacts. Our approach, D$^2$-Randomized Gait Modulation with Bezier Curves (D$^2$-GMBC), uses augmented random search with randomized dynamics and terrain to train, in simulation, a policy that modifies the parameters and output of an open-loop Bezier curve gait generator for quadrupedal robots. The policy, using only inertial measurements, enables the robot to traverse unknown rough terrain, even when the robot's physical parameters do not match the open-loop model. We compare the resulting policy to hand-tuned Bezier Curve gaits and to policies trained without randomization, both in simulation and on a real quadrupedal robot. With D$^2$-GMBC, across a variety of experiments on unobserved and unknown uneven terrain, the robot walks significantly farther than with either hand-tuned gaits or gaits learned without domain randomization. Additionally, using D$^2$-GMBC, the robot can walk laterally and rotate while on the rough terrain, even though it was trained only for forward walking.


title: Translating Recursive Probabilistic Programs to Factor Graph Grammars

abstract: It is natural for probabilistic programs to use conditionals to express alternative substructures in models, and loops (recursion) to express repeated substructures in models. Thus, probabilistic programs with conditionals and recursion motivate ongoing interest in efficient and general inference. A factor graph grammar (FGG) generates a set of factor graphs that do not all need to be enumerated in order to perform inference. We provide a semantics-preserving translation from first-order probabilistic programs with conditionals and recursion to FGGs.


title: Long- and Short-Ranged Chiral Interactions in DNA Assembled Plasmonic Chains

abstract: Molecular chirality plays a crucial role in innumerable biological processes. The chirality of a molecule can typically be identified by its characteristic optical response, the circular dichroism (CD). CD signals have thus long been used to identify the state of molecules or to follow dynamic protein configurations. In recent years, the focus has moved towards plasmonic nanostructures, as they show potential for applications ranging from pathogen sensing to novel optical materials. The plasmonic coupling of the individual elements of such chiral metallic structures is a crucial prerequisite to obtain sizeable CD signals. We here identified and implemented various coupling entities - chiral and achiral - to obtain chiral transfer over distances close to 100 nm. The coupling is realized by an achiral nanosphere situated between a pair of gold nanorods that are arranged far apart but in a chiral fashion. We synthesized these structures with nanometer precision using DNA origami and obtained sample homogeneity that allowed us to directly demonstrate efficient chiral energy transfer between the distant nanorods. The transmitter particle causes a strong enhancement in amplitude of the CD response, the emergence of an additional chiral feature at the resonance frequency of the nanosphere, and a redshift of the longitudinal plasmonic resonance frequency of the nanorods. Numerical simulations closely match our experimental observations and give insights in the intricate behavior of chiral optical fields and the transfer of plasmons in complex architectures.


title: Experimental generation of Helical Mathieu-Gauss vector modes

abstract: Vector modes represent the most general state of light in which, the spatial and polarisation degrees of freedom are coupled in a non-separable way. Crucially, while polarisation is limited to a bi-dimensional space, the spatial degree of freedom can take any spatial profile. However, most generation and application techniques are mainly limited to spatial modes with polar cylindrical symmetry, such as Laguerre- and Bessel-Gauss modes. In this manuscript we put forward a novel class of vector modes with its spatial degree of freedom encoded in the set of helical Mathieu-Gauss beams of the elliptical cylindrical coordinates. We first introduce these modes theoretically and outline their geometric representation on the higher-order Poincar\'e sphere. Later on, we demonstrate their experimental generation using a polarisation-insensitive technique comprising the use of a digital micromirror device. Finally, we provide with a qualitative and a quantitative characterisation of the same using modern approaches based on quantum mechanics tools. It is worth mentioning that non-polar vector beams are highly desired in various applications, such as optical trapping and optical communications.


title: A Statistical Theory of Heavy Atoms: Energy and Excess Charge

abstract: The purpose of this note is to give an elementary derivation of a lower bound on the relativistic Thomas-Fermi-Weizs\"acker-Dirac functional of Thomas-Fermi type and to apply it to get an upper bound on the excess charge of this model.


title: The basis of easy controllability in Boolean networks

abstract: Effective control of biological systems can often be achieved through the control of a surprisingly small number of distinct variables. We bring clarity to such results using the formalism of Boolean dynamical networks, analyzing the effectiveness of external control in selecting a desired final state when that state is among the original attractors of the dynamics. Analyzing 49 existing biological network models, we find strong numerical evidence that the average number of nodes that must be forced scales logarithmically with the number of original attractors. This suggests that biological networks may be typically easy to control even when the number of interacting components is large. We provide a theoretical explanation of the scaling by separating controlling nodes into three types: those that act as inputs, those that distinguish among attractors, and any remaining nodes. We further identify characteristics of dynamics that can invalidate this scaling, and speculate about how this relates more broadly to non-biological systems.


title: Conceptual Design of BabyIAXO, the intermediate stage towards the International Axion Observatory

abstract: This article describes BabyIAXO, an intermediate experimental stage of the International Axion Observatory (IAXO), proposed to be sited at DESY. IAXO is a large-scale axion helioscope that will look for axions and axion-like particles (ALPs), produced in the Sun, with unprecedented sensitivity. BabyIAXO is conceived to test all IAXO subsystems (magnet, optics and detectors) at a relevant scale for the final system and thus serve as prototype for IAXO, but at the same time as a fully-fledged helioscope with relevant physics reach itself, and with potential for discovery. The BabyIAXO magnet will feature two 10 m long, 70 cm diameter bores, and will host two detection lines (optics and detector) of dimensions similar to the final ones foreseen for IAXO. BabyIAXO will detect or reject solar axions or ALPs with axion-photon couplings down to $g_{a\gamma} \sim 1.5 \times 10^{-11}$ GeV$^{-1}$, and masses up to $m_a\sim 0.25$ eV. BabyIAXO will offer additional opportunities for axion research in view of IAXO, like the development of precision x-ray detectors to identify particular spectral features in the solar axion spectrum, and the implementation of radiofrequency-cavity-based axion dark matter setups.


title: Summarizing Utterances from Japanese Assembly Minutes using Political Sentence-BERT-based Method for QA Lab-PoliInfo-2 Task of NTCIR-15

abstract: There are many discussions held during political meetings, and a large number of utterances for various topics is included in their transcripts. We need to read all of them if we want to follow speakers\' intentions or opinions about a given topic. To avoid such a costly and time-consuming process to grasp often longish discussions, NLP researchers work on generating concise summaries of utterances. Summarization subtask in QA Lab-PoliInfo-2 task of the NTCIR-15 addresses this problem for Japanese utterances in assembly minutes, and our team (SKRA) participated in this subtask. As a first step for summarizing utterances, we created a new pre-trained sentence embedding model, i.e. the Japanese Political Sentence-BERT. With this model, we summarize utterances without labelled data. This paper describes our approach to solving the task and discusses its results.


title: Zoom on the Keystrokes: Exploiting Video Calls for Keystroke Inference Attacks

abstract: Due to recent world events, video calls have become the new norm for both personal and professional remote communication. However, if a participant in a video call is not careful, he/she can reveal his/her private information to others in the call. In this paper, we design and evaluate an attack framework to infer one type of such private information from the video stream of a call -- keystrokes, i.e., text typed during the call. We evaluate our video-based keystroke inference framework using different experimental settings and parameters, including different webcams, video resolutions, keyboards, clothing, and backgrounds. Our relatively high keystroke inference accuracies under commonly occurring and realistic settings highlight the need for awareness and countermeasures against such attacks. Consequently, we also propose and evaluate effective mitigation techniques that can automatically protect users when they type during a video call.


title: Why Two-Dimensional Semiconductors Generally Have Low Electron Mobility

abstract: Atomically thin (two-dimensional, 2D) semiconductors have shown great potential as the fundamental building blocks for next-generation electronics. However, all the 2D semiconductors that have been experimentally made so far have room-temperature electron mobility lower than that of bulk silicon, which is not understood. Here, by using first-principles calculations and reformulating the transport equations to isolate and quantify contributions of different mobility-determining factors, we show that the universally low mobility of 2D semiconductors originates from the high 'density of scatterings,' which is intrinsic to the 2D material with a parabolic electron band. The density of scatterings characterizes the density of phonons that can interact with the electrons and can be fully determined from the electron and phonon band structures without knowledge of electron-phonon coupling strength. Our work reveals the underlying physics limiting the electron mobility of 2D semiconductors and offers a descriptor to quickly assess the mobility.


title: Getting Passive Aggressive About False Positives: Patching Deployed Malware Detectors

abstract: False positives (FPs) have been an issue of extreme importance for anti-virus (AV) systems for decades. As more security vendors turn to machine learning, alert deluge has hit critical mass with over 20% of all alerts resulting in FPs and, in some organizations, the number reaches half of all alerts. This increase has resulted in fatigue, frustration, and, worst of all, neglect from security workers on SOC teams. A foundational cause for FPs is that vendors must build one global system to try and satisfy all customers, but have no method to adjust to individual local environments. This leads to outrageous, albeit technically correct, characterization of their platforms being 99.9% effective. Once these systems are deployed the idiosyncrasies of individual, local environments expose blind spots that lead to FPs and uncertainty. We propose a strategy for fixing false positives in production after a model has already been deployed. For too long the industry has tried to combat these problems with inefficient, and at times, dangerous allowlist techniques and excessive model retraining which is no longer enough. We propose using a technique called passive-aggressive learning to alter a malware detection model to an individual's environment, eliminating false positives without sharing any customer sensitive information. We will show how to use passive-aggressive learning to solve a collection of notoriously difficult false positives from a production environment without compromising the malware model's accuracy, reducing the total number of FP alerts by an average of 23x.


title: Singularity of random integer matrices with large entries

abstract: We study the singularity probability of random integer matrices. Concretely, the probability that a random $n \times n$ matrix, with integer entries chosen uniformly from $\{-m,\ldots,m\}$, is singular. This problem has been well studied in two regimes: large $n$ and constant $m$; or large $m$ and constant $n$. In this paper, we extend previous techniques to handle the regime where both $n,m$ are large. We show that the probability that such a matrix is singular is $m^{-cn}$ for some absolute constant $c>0$. We also provide some connections of our result to coding theory.