title: Efficiently Trained Low-Resource Mongolian Text-to-Speech System Based On FullConv-TTS

abstract: Recurrent Neural Networks (RNNs) have become the standard modeling technique for sequence data, and are used in a number of novel text-to-speech models. However, training a TTS model including RNN components has certain requirements for GPU performance and takes a long time. In contrast, studies have shown that CNN-based sequence synthesis technology can greatly reduce training time in text-to-speech models while ensuring a certain performance due to its high parallelism. We propose a new text-to-speech system based on deep convolutional neural networks that does not employ any RNN components (recurrent units). At the same time, we improve the generality and robustness of our model through a series of data augmentation methods such as Time Warping, Frequency Mask, and Time Mask. The final experimental results show that the TTS model using only the CNN component can reduce the training time compared to the classic TTS models such as Tacotron while ensuring the quality of the synthesized speech.


title: Impact of multiple modes on the evolution of self-interacting axion condensate around rotating black holes

abstract: Ultra-light particles, such as axions, form a macroscopic condensate around a highly spinning black hole by the superradiant instability. Due to its macroscopic nature, the condensate opens the possibility of detecting the axion through gravitational wave observations. However, the precise evolution of the condensate must be known for the actual detection. For future observation, we numerically study the influence of the self-interaction, especially interaction between different modes, on the evolution of the condensate in detail. First, we focus on the case when condensate starts with the smallest possible angular quantum number. For this case, we perform the non-linear calculation and show that the dissipation induced by the mode interaction is strong enough to saturate the superradiant instability, even if the secondary cloud starts with quantum fluctuations. Our result indicates that explosive phenomena such as bosenova do not occur in this case. We also show that the condensate settles to a quasi-stationary state mainly composed of two modes, one with the smallest angular quantum number for which the superradiant instability occurs and the other with the adjacent higher angular quantum number. We also study the case when the condensate starts with the dominance of the higher angular quantum number. We show that the dissipation process induced by the mode coupling does not occur for small gravitational coupling. Therefore, bosenova might occur in this case.


title: Unlocking the potential of two-point cells for energy-efficient and resilient training of deep nets

abstract: Context-sensitive two-point layer 5 pyramidal cells (L5PCs) were discovered as long ago as 1999. However, the potential of this discovery to provide useful neural computation has yet to be demonstrated. Here we show for the first time how a transformative L5PCs-driven deep neural network (DNN), termed the multisensory cooperative computing (MCC) architecture, can effectively process large amounts of heterogeneous real-world audio-visual (AV) data, using far less energy compared to best available 'point' neuron-driven DNNs. A novel highly-distributed parallel implementation on a Xilinx UltraScale+ MPSoC device estimates energy savings up to 245759 $ \times $ 50000 $\mu$J (i.e., 62% less than the baseline model in a semi-supervised learning setup) where a single synapse consumes $8e^{-5}\mu$J. In a supervised learning setup, the energy-saving can potentially reach up to 1250x less (per feedforward transmission) than the baseline model. The significantly reduced neural activity in MCC leads to inherently fast learning and resilience against sudden neural damage. This remarkable performance in pilot experiments demonstrates the embodied neuromorphic intelligence of our proposed cooperative L5PC that receives input from diverse neighbouring neurons as context to amplify the transmission of most salient and relevant information for onward transmission, from overwhelmingly large multimodal information utilised at the early stages of on-chip training. Our proposed approach opens new cross-disciplinary avenues for future on-chip DNN training implementations and posits a radical shift in current neuromorphic computing paradigms.


title: Creating an Optimal Portfolio of Crops Using Price Forecasting to Increase ROI for Indian Farmers

abstract: The Indian agricultural sector being in a constant phase of upgradation, has been on the road to modernization for the last couple of years. The fundamental source of livelihood for over 70 percent of the population living in rural parts of the country is still agriculture. The average Indian farmer, although has access to raw and trend data pertaining to crop prices, yield and demand from Indian government and private websites, still struggles to make the right choices. They are constantly faced with the dilemma of choosing the right crop to address market demand and fetch them a decent profit. Since the process of shortlisting crops amongst the many suitable ones isn't completely scientific and usually dictated by area tradition, this project has aimed to address that issue by forecasting the price of those crops and uses that to create an optimal portfolio that the farmers can obtain to arrive at a data-driven decision for crop selection with optimal estimated ROI.


title: Spiking Variational Graph Auto-Encoders for Efficient Graph Representation Learning

abstract: Graph representation learning is a fundamental research issue and benefits a wide range of applications on graph-structured data. Conventional artificial neural network-based methods such as graph neural networks (GNNs) and variational graph auto-encoders (VGAEs) have achieved promising results in learning on graphs, but they suffer from extremely high energy consumption during training and inference stages. Inspired by the bio-fidelity and energy-efficiency of spiking neural networks (SNNs), recent methods attempt to adapt GNNs to the SNN framework by substituting spiking neurons for the activation functions. However, existing SNN-based GNN methods cannot be applied to the more general multi-node representation learning problem represented by link prediction. Moreover, these methods did not fully exploit the bio-fidelity of SNNs, as they still require costly multiply-accumulate (MAC) operations, which severely harm the energy efficiency. To address the above issues and improve energy efficiency, in this paper, we propose an SNN-based deep generative method, namely the Spiking Variational Graph Auto-Encoders (S-VGAE) for efficient graph representation learning. To deal with the multi-node problem, we propose a probabilistic decoder that generates binary latent variables as spiking node representations and reconstructs graphs via the weighted inner product. To avoid the MAC operations for energy efficiency, we further decouple the propagation and transformation layers of conventional GNN aggregators. We conduct link prediction experiments on multiple benchmark graph datasets, and the results demonstrate that our model consumes significantly lower energy with the performances superior or comparable to other ANN- and SNN-based methods for graph representation learning.


title: Epitaxial hexagonal boron nitride for hydrogen generation by radiolysis of interfacial water

abstract: Hydrogen is an important building block in global strategies towards a future green energy system. To make this transition possible, intense scientific efforts are needed, also in the field of materials science. Two-dimensional crystals, such as hexagonal boron nitride (hBN), are very promising in this regard, as it was demonstrated that micrometer-sized exfoliated flakes are excellent barriers to molecular hydrogen. However, it remains an open question whether large-area layers fabricated by industrially relevant methods preserve such promising properties. In this work we show that electron beam-induced splitting of water creates hBN bubbles that effectively store molecular hydrogen for weeks and under extreme mechanical deformation. We demonstrate that epitaxial hBN allows direct visualization and monitoring of the process of hydrogen generation by radiolysis of interfacial water. Our findings show that hBN is not only a potential candidate for hydrogen storage, but also holds promise for the development of unconventional hydrogen production schemes.


title: A BERT-based Deep Learning Approach for Reputation Analysis in Social Media

abstract: Social media has become an essential part of the modern lifestyle, with its usage being highly prevalent. This has resulted in unprecedented amounts of data generated from users in social media, such as users' attitudes, opinions, interests, purchases, and activities across various aspects of their lives. Therefore, in a world of social media, where its power has shifted to users, actions taken by companies and public figures are subject to constantly being under scrutiny by influential global audiences. As a result, reputation management in social media has become essential as companies and public figures need to maintain their reputation to preserve their reputation capital. However, domain experts still face the challenge of lacking appropriate solutions to automate reliable online reputation analysis. To tackle this challenge, we proposed a novel reputation analysis approach based on the popular language model BERT (Bidirectional Encoder Representations from Transformers). The proposed approach was evaluated on the reputational polarity task using RepLab 2013 dataset. Compared to previous works, we achieved 5.8% improvement in accuracy, 26.9% improvement in balanced accuracy, and 21.8% improvement in terms of F-score.


title: Quantifying the `end of history' through a Bayesian Markov-chain approach

abstract: Political regimes have been changing throughout human history. After the apparent triumph of liberal democracies at the end of the twentieth century, Francis Fukuyama and others have been arguing that humankind is approaching an `end of history' (EoH) in the form of a universality of liberal democracies. This view has been challenged by recent developments that seem to indicate the rise of defective democracies across the globe. There has been no attempt to quantify the expected EoH with a statistical approach. In this study, we model the transition between political regimes as a Markov process and -- using a Bayesian inference approach -- we estimate the transition probabilities between political regimes from time-series data describing the evolution of political regimes from 1800--2018. We then compute the steady state for this Markov process which represents a mathematical abstraction of the EoH and predicts that approximately 46 % of countries will be full democracies. Furthermore, we find that, under our model, the fraction of autocracies in the world is expected to increase for the next half-century before it declines. Using random-walk theory, we then estimate survival curves of different types of regimes and estimate characteristic lifetimes of democracies and autocracies of 244 years and 69 years, respectively. Quantifying the expected EoH allows us to challenge common beliefs about the nature of political equilibria. Specifically, we find no statistical evidence that the EoH constitutes a fixed, complete omnipresence of democratic regimes.


title: Simple Continued Fractions an Approach for High School Students

abstract: This paper aims to introduce high school students to the intriguing world of continued fractions, a mathematical concept that provides a unique representation of numbers. The study focuses on the exploration and development of the fundamental properties of both Finite and Infinite Continued Fractions. It further delves into the computation of quadratic numbers using given periodic continued fractions and the concept of conjugate quadratic numbers. A significant part of the paper is dedicated to the approximation of real numbers and the convergence properties of continued fractions. The study of continued fractions offers a profound understanding of the intricate relationships within number systems, a key emphasis in contemporary mathematics education. The paper is designed to be engaging and interactive, fostering a fun and stimulating learning environment. By the end of this study, students will have gained a comprehensive understanding of continued fractions, their properties, and their applications, thus enhancing their mathematical proficiency and problem-solving skills. This paper serves as a stepping stone for students to explore more complex mathematical concepts and theories, fostering a deeper appreciation for the subject.


title: Sub-network Multi-objective Evolutionary Algorithm for Filter Pruning

abstract: Filter pruning is a common method to achieve model compression and acceleration in deep neural networks (DNNs).Some research regarded filter pruning as a combinatorial optimization problem and thus used evolutionary algorithms (EA) to prune filters of DNNs. However, it is difficult to find a satisfactory compromise solution in a reasonable time due to the complexity of solution space searching. To solve this problem, we first formulate a multi-objective optimization problem based on a sub-network of the full model and propose a Sub-network Multiobjective Evolutionary Algorithm (SMOEA) for filter pruning. By progressively pruning the convolutional layers in groups, SMOEA can obtain a lightweight pruned result with better performance.Experiments on VGG-14 model for CIFAR-10 verify the effectiveness of the proposed SMOEA. Specifically, the accuracy of the pruned model with 16.56% parameters decreases by 0.28% only, which is better than the widely used popular filter pruning criteria.


title: An Efficient Approach with Dynamic Multi-Swarm of UAVs for Forest Firefighting

abstract: In this paper, the Multi-Swarm Cooperative Information-driven search and Divide and Conquer mitigation control (MSCIDC) approach is proposed for faster detection and mitigation of forest fire by reducing the loss of biodiversity, nutrients, soil moisture, and other intangible benefits. A swarm is a cooperative group of Unmanned Aerial Vehicles (UAVs) that fly together to search and quench the fire effectively. The multi-swarm cooperative information-driven search uses a multi-level search comprising cooperative information-driven exploration and exploitation for quick/accurate detection of fire location. The search level is selected based on the thermal sensor information about the potential fire area. The dynamicity of swarms, aided by global regulative repulsion and merging between swarms, reduces the detection and mitigation time compared to the existing methods. The local attraction among the members of the swarm helps the non-detector members to reach the fire location faster, and divide-and-conquer mitigation control ensures a non-overlapping fire sector allocation for all members quenching the fire. The performance of MSCIDC has been compared with different multi-UAV methods using a simulated environment of pine forest. The performance clearly shows that MSCIDC mitigates fire much faster than the multi-UAV methods. The Monte-Carlo simulation results indicate that the proposed method reduces the average forest area burnt by $65\%$ and mission time by $60\%$ compared to the best result case of the multi-UAV approaches, guaranteeing a faster and successful mission.


title: An agent-based approach to procedural city generation incorporating Land Use and Transport Interaction models

abstract: We apply the knowledge of urban settings established with the study of Land Use and Transport Interaction (LUTI) models to develop reward functions for an agent-based system capable of planning realistic artificial cities. The system aims to replicate in the micro scale the main components of real settlements, such as zoning and accessibility in a road network. Moreover, we propose a novel representation for the agent's environment that efficiently combines the road graph with a discrete model for the land. Our system starts from an empty map consisting only of the road network graph, and the agent incrementally expands it by building new sites while distinguishing land uses between residential, commercial, industrial, and recreational.


title: FingerFlex: Inferring Finger Trajectories from ECoG signals

abstract: Motor brain-computer interface (BCI) development relies critically on neural time series decoding algorithms. Recent advances in deep learning architectures allow for automatic feature selection to approximate higher-order dependencies in data. This article presents the FingerFlex model - a convolutional encoder-decoder architecture adapted for finger movement regression on electrocorticographic (ECoG) brain data. State-of-the-art performance was achieved on a publicly available BCI competition IV dataset 4 with a correlation coefficient between true and predicted trajectories up to 0.74. The presented method provides the opportunity for developing fully-functional high-precision cortical motor brain-computer interfaces.


title: Reoptimization Nearly Solves Weakly Coupled Markov Decision Processes

abstract: We propose a new policy, called the LP-update policy, to solve finite horizon weakly-coupled Markov decision processes. The latter can be seen as multi-constraint multi-action bandits, and generalize the classical restless bandit problems. Our solution is based on re-solving periodically a relaxed version of the original problem, that can be cast as a linear program (LP). When the problem is made of $N$ statistically identical sub-components, we show that the LP-update policy becomes asymptotically optimal at rate $O(T^2/\sqrt{N})$. This rate can be improved to $O(T/\sqrt{N})$ if the problem satisfies some ergodicity property and to $O(1/N)$ if the problem is non-degenerate. The definition of non-degeneracy extends the same notion for restless bandits. By using this property, we also improve the computational efficiency of the LP-update policy. We illustrate the performance of our policy on randomly generated examples, as well as a generalized applicant screening problem, and show that it outperforms existing heuristics.


title: GEC: A Unified Framework for Interactive Decision Making in MDP, POMDP, and Beyond

abstract: We study sample efficient reinforcement learning (RL) under the general framework of interactive decision making, which includes Markov decision process (MDP), partially observable Markov decision process (POMDP), and predictive state representation (PSR) as special cases. Toward finding the minimum assumption that empowers sample efficient learning, we propose a novel complexity measure, generalized eluder coefficient (GEC), which characterizes the fundamental tradeoff between exploration and exploitation in online interactive decision making. In specific, GEC captures the hardness of exploration by comparing the error of predicting the performance of the updated policy with the in-sample training error evaluated on the historical data. We show that RL problems with low GEC form a remarkably rich class, which subsumes low Bellman eluder dimension problems, bilinear class, low witness rank problems, PO-bilinear class, and generalized regular PSR, where generalized regular PSR, a new tractable PSR class identified by us, includes nearly all known tractable POMDPs and PSRs. Furthermore, in terms of algorithm design, we propose a generic posterior sampling algorithm, which can be implemented in both model-free and model-based fashion, under both fully observable and partially observable settings. The proposed algorithm modifies the standard posterior sampling algorithm in two aspects: (i) we use an optimistic prior distribution that biases towards hypotheses with higher values and (ii) a loglikelihood function is set to be the empirical loss evaluated on the historical data, where the choice of loss function supports both model-free and model-based learning. We prove that the proposed algorithm is sample efficient by establishing a sublinear regret upper bound in terms of GEC. In summary, we provide a new and unified understanding of both fully observable and partially observable RL.


title: Machine Learning Methods for Device Identification Using Wireless Fingerprinting

abstract: Industrial Internet of Things (IoT) systems increasingly rely on wireless communication standards. In a common industrial scenario, indoor wireless IoT devices communicate with access points to deliver data collected from industrial sensors, robots and factory machines. Due to static or quasi-static locations of IoT devices and access points, historical observations of IoT device channel conditions provide a possibility to precisely identify the device without observing its traditional identifiers (e.g., MAC or IP address). Such device identification methods based on wireless fingerprinting gained increased attention lately as an additional cyber-security mechanism for critical IoT infrastructures. In this paper, we perform a systematic study of a large class of machine learning algorithms for device identification using wireless fingerprints for the most popular cellular and Wi-Fi IoT technologies. We design, implement, deploy, collect relevant data sets, train and test a multitude of machine learning algorithms, as a part of the complete end-to-end solution design for device identification via wireless fingerprinting. The proposed solution is currently being deployed in a real-world industrial IoT environment as part of H2020 project COLLABS.


title: Combining Contrastive and Non-Contrastive Losses for Fine-Tuning Pretrained Models in Speech Analysis

abstract: Embedding paralinguistic properties is a challenging task as there are only a few hours of training data available for domains such as emotional speech. One solution to this problem is to pretrain a general self-supervised speech representation model on large amounts of unlabeled speech. This pretrained model is then finetuned to a specific task. Paralinguistic properties however have notoriously high class variance, making the finetuning ineffective. In this work, we propose a two step approach to this. First we improve the embedding space, then we train an adapter to bridge the gap from the embedding space to a classification task. In order to improve the class invariance we use a combination of contrastive and non-contrastive losses to explicitly optimize for class invariant, yet discriminative features. Our approach consistently outperforms baselines that are finetuned end-to-end on multiple tasks and surpasses a benchmark on state-of-the-art emotion classification.


title: On non-geometric augmentations in high dimensions

abstract: In this note we construct augmentations of Chekanov-Eliashberg algebras of certain high dimensional Legendrian submanifolds that are not induced by exact Lagrangian fillings. The obstructions to the existence of exact Lagrangian fillings that we use are Seidel's isomorphism and the injectivity of a certain algebraic map between the corresponding augmentation varieties proven by Gao and Rutherford. In addition, along the way we discuss the relation between augmentation varieties of Legendrian submanifolds and their spherical spuns.


title: MarginNCE: Robust Sound Localization with a Negative Margin

abstract: The goal of this work is to localize sound sources in visual scenes with a self-supervised approach. Contrastive learning in the context of sound source localization leverages the natural correspondence between audio and visual signals where the audio-visual pairs from the same source are assumed as positive, while randomly selected pairs are negatives. However, this approach brings in noisy correspondences; for example, positive audio and visual pair signals that may be unrelated to each other, or negative pairs that may contain semantically similar samples to the positive one. Our key contribution in this work is to show that using a less strict decision boundary in contrastive learning can alleviate the effect of noisy correspondences in sound source localization. We propose a simple yet effective approach by slightly modifying the contrastive loss with a negative margin. Extensive experimental results show that our approach gives on-par or better performance than the state-of-the-art methods. Furthermore, we demonstrate that the introduction of a negative margin to existing methods results in a consistent improvement in performance.


title: On a Calder\'on preconditioner for the symmetric formulation of the electroencephalography forward problem without barycentric refinements

abstract: We present a Calder\'on preconditioning scheme for the symmetric formulation of the forward electroencephalographic (EEG) problem that cures both the dense discretization and the high-contrast breakdown. Unlike existing Calder\'on schemes presented for the EEG problem, it is refinement-free, that is, the electrostatic integral operators are not discretized with basis functions defined on the barycentrically-refined dual mesh. In fact, in the preconditioner, we reuse the original system matrix thus reducing computational burden. Moreover, the proposed formulation gives rise to a symmetric, positive-definite system of linear equations, which allows the application of the conjugate gradient method, an iterative method that exhibits a smaller computational cost compared to other Krylov subspace methods applicable to non-symmetric problems. Numerical results corroborate the theoretical analysis and attest of the efficacy of the proposed preconditioning technique on both canonical and realistic scenarios.


title: Controlling the dispersion of longitudinal waves via the affine deformation of the interlaced wire medium

abstract: We studied the dispersion properties of double interlaced wire metamaterials with geometry modified by affine transformation. That metamaterials were found to support eigenmodes with longitudinal polarization at low frequencies for all deformations. Due to the spatial dispersion the metamaterials isofrequency surfaces are centered at the Brillouin zone edges (rather than at $\Gamma$-point) and have the shape of ellipsoids. The refractive indices corresponding to the ellipsoids were analyzed both analytically and numerically.


title: Grounding Scene Graphs on Natural Images via Visio-Lingual Message Passing

abstract: This paper presents a framework for jointly grounding objects that follow certain semantic relationship constraints given in a scene graph. A typical natural scene contains several objects, often exhibiting visual relationships of varied complexities between them. These inter-object relationships provide strong contextual cues toward improving grounding performance compared to a traditional object query-only-based localization task. A scene graph is an efficient and structured way to represent all the objects and their semantic relationships in the image. In an attempt towards bridging these two modalities representing scenes and utilizing contextual information for improving object localization, we rigorously study the problem of grounding scene graphs on natural images. To this end, we propose a novel graph neural network-based approach referred to as Visio-Lingual Message PAssing Graph Neural Network (VL-MPAG Net). In VL-MPAG Net, we first construct a directed graph with object proposals as nodes and an edge between a pair of nodes representing a plausible relation between them. Then a three-step inter-graph and intra-graph message passing is performed to learn the context-dependent representation of the proposals and query objects. These object representations are used to score the proposals to generate object localization. The proposed method significantly outperforms the baselines on four public datasets.


title: AI enhanced finite element multiscale modelling and structural uncertainty analysis of a functionally graded porous beam

abstract: The local geometrical randomness of metal foams brings complexities to the performance prediction of porous structures. Although the relative density is commonly deemed as the key factor, the stochasticity of internal cell sizes and shapes has an apparent effect on the porous structural behaviour but the corresponding measurement is challenging. To address this issue, we are aimed to develop an assessment strategy for efficiently examining the foam properties by combining multiscale modelling and deep learning. The multiscale modelling is based on the finite element (FE) simulation employing representative volume elements (RVEs) with random cellular morphologies, mimicking the typical features of closed-cell Aluminium foams. A deep learning database is constructed for training the designed convolutional neural networks (CNNs) to establish a direct link between the mesoscopic porosity characteristics and the effective Youngs modulus of foams. The error range of CNN models leads to an uncertain mechanical performance, which is further evaluated in a structural uncertainty analysis on the FG porous three-layer beam consisting of two thin high-density layers and a thick low-density one, where the imprecise CNN predicted moduli are represented as triangular fuzzy numbers in double parametric form. The uncertain beam bending deflections under a mid-span point load are calculated with the aid of Timoshenko beam theory and the Ritz method. Our findings suggest the success in training CNN models to estimate RVE modulus using images with an average error of 5.92%. The evaluation of FG porous structures can be significantly simplified with the proposed method and connects to the mesoscopic cellular morphologies without establishing the mechanics model for local foams.


title: Detecting nuclear mass distribution in isobar collisions via charmonium

abstract: The collective properties of final state hadrons produced in the high statistics $_{44}^{96}$Ru+$_{44}^{96}$Ru and $_{40}^{96}$Zr+$_{40}^{96}$Zr collisions at $\sqrt{s_\mathrm{NN}} = 200~\mathrm{GeV}$ are found to be significantly different. Such differences were argued to be precise probes of the difference in nucleon distribution in the isobar nuclei. We investigate the $J/\psi$ production in the isobar collision via a relativistic transport approach. By comparing the isobar systems according to equal centrality bin and equal multiplicity bin, we find that the yield ratio of $J/\psi$ is sensitive to the differences in both the number of binary collisions and the medium evolution. Besides, the elliptic flow $v_2$ of $J/\psi$ is qualitatively different from the light hadrons, and the ratio between Ru+Ru and Zr+Zr collisions is sensitive to the medium evolution. The charmonium production provides an independent probe to study the nucleon distribution in the isobar system.


title: The role of prior information and computational power in Machine Learning

abstract: Science consists on conceiving hypotheses, confronting them with empirical evidence, and keeping only hypotheses which have not yet been falsified. Under deductive reasoning they are conceived in view of a theory and confronted with empirical evidence in an attempt to falsify it, and under inductive reasoning they are conceived based on observation, confronted with empirical evidence and a theory is established based on the not falsified hypotheses. When the hypotheses testing can be performed with quantitative data, the confrontation can be achieved with Machine Learning methods, whose quality is highly dependent on the hypotheses' complexity, hence on the proper insertion of prior information into the set of hypotheses seeking to decrease its complexity without loosing good hypotheses. However, Machine Learning tools have been applied under the pragmatic view of instrumentalism, which is concerned only with the performance of the methods and not with the understanding of their behavior, leading to methods which are not fully understood. In this context, we discuss how prior information and computational power can be employed to solve a learning problem, but while prior information and a careful design of the hypotheses space has as advantage the interpretability of the results, employing high computational power has the advantage of a higher performance. We discuss why learning methods which combine both should work better from an understanding and performance perspective, arguing in favor of basic theoretical research on Machine Learning, in special about how properties of classifiers may be identified in parameters of modern learning models.


title: On the invariant region for compressible Euler equations with a general equation of state

abstract: The state space for solutions of the compressible Euler equations with a general equation of state is examined. An arbitrary equation of state is allowed, subject only to the physical requirements of thermodynamics. An invariant region of the resulting Euler system is identified and the convexity property of this region is justified by using only very minimal thermodynamical assumptions. Finally, we show how an invariant-region-preserving (IRP) limiter can be constructed for use in high order finite-volume type schemes to solve the compressible Euler equations with a general constitutive relation.


title: Discrete approximations to Dirichlet and Neumann Laplacians on a half-space and norm resolvent convergence

abstract: We extend recent results on discrete approximations of the Laplacian in $\mathbf{R}^d$ with norm resolvent convergence to the corresponding results for Dirichlet and Neumann Laplacians on a half-space. The resolvents of the discrete Dirichlet/Neumann Laplacians are embedded into the continuum using natural discretization and embedding operators. Norm resolvent convergence to their continuous counterparts is proven with a quadratic rate in the mesh size. These results generalize with a limited rate to also include operators with a real, bounded, and H\"older continuous potential, as well as certain functions of the Dirichlet/Neumann Laplacians, including any positive real power.

categories: math.FA cs.NA math-ph math.MP math.NA math.SP


title: Dynamical fermionization in one-dimensional spinor gases at finite temperature

abstract: Following the removal of axial confinement, the momentum distribution of a Tonks-Girardeau gas approaches that of a system of noninteracting spinless fermions in the initial harmonic trap. This phenomenon, called dynamical fermionization, has been experimentally confirmed in the case of the Lieb-Liniger model and theoretically predicted in the case of multicomponent systems at zero temperature. We prove analytically that for all spinor gases with strong repulsive contact interactions at finite temperature the momentum distribution after release from the trap asymptotically approaches that of a system of spinless fermions at the same temperature but with a renormalized chemical potential which depends on the number of components of the spinor system. In the case of the Gaudin-Yang model we check numerically our analytical predictions using the results obtained from a nonequilibrium generalization of Lenard's formula describing the time evolution of the field-field correlators.


title: Enhancing Patent Retrieval using Text and Knowledge Graph Embeddings: A Technical Note

abstract: Patent retrieval influences several applications within engineering design research, education, and practice as well as applications that concern innovation, intellectual property, and knowledge management etc. In this article, we propose a method to retrieve patents relevant to an initial set of patents, by synthesizing state-of-the-art techniques among natural language processing and knowledge graph embedding. Our method involves a patent embedding that captures text, citation, and inventor information, which individually represent different facets of knowledge communicated through a patent document. We obtain text embeddings using Sentence-BERT applied to titles and abstracts. We obtain citation and inventor embeddings through TransE that is trained using the corresponding knowledge graphs. We identify using a classification task that the concatenation of text, citation, and inventor embeddings offers a plausible representation of a patent. While the proposed patent embedding could be used to associate a pair of patents, we observe using a recall task that multiple initial patents could be associated with a target patent using mean cosine similarity, which could then be utilized to rank all target patents and retrieve the most relevant ones. We apply the proposed patent retrieval method to a set of patents corresponding to a product family and an inventor's portfolio.


title: Galois Groups of Linear Difference-Differential Equations

abstract: We study the relation between the Galois group $G$ of a linear difference-differential system and two classes $\mathcal{C}_1$ and $\mathcal{C}_2$ of groups that are the Galois groups of the specializations of the linear difference equation and the linear differential equation in this system respectively. We show that almost all groups in $\mathcal{C}_1\cup \mathcal{C}_2$ are algebraic subgroups of $G$, and there is a nonempty subset of $\mathcal{C}_1$ and a nonempty subset of $\mathcal{C}_2$ such that $G$ is the product of any pair of groups from these two subsets. These results have potential application to the computation of the Galois group of a linear difference-differential system. We also give a criterion for testing linear dependence of elements in a simple difference-differential ring, which generalizes Kolchin's criterion for partial differential fields.


title: PEMP: Leveraging Physics Properties to Enhance Molecular Property Prediction

abstract: Molecular property prediction is essential for drug discovery. In recent years, deep learning methods have been introduced to this area and achieved state-of-the-art performances. However, most of existing methods ignore the intrinsic relations between molecular properties which can be utilized to improve the performances of corresponding prediction tasks. In this paper, we propose a new approach, namely Physics properties Enhanced Molecular Property prediction (PEMP), to utilize relations between molecular properties revealed by previous physics theory and physical chemistry studies. Specifically, we enhance the training of the chemical and physiological property predictors with related physics property prediction tasks. We design two different methods for PEMP, respectively based on multi-task learning and transfer learning. Both methods include a model-agnostic molecule representation module and a property prediction module. In our implementation, we adopt both the state-of-the-art molecule embedding models under the supervised learning paradigm and the pretraining paradigm as the molecule representation module of PEMP, respectively. Experimental results on public benchmark MoleculeNet show that the proposed methods have the ability to outperform corresponding state-of-the-art models.


title: Tiny-Attention Adapter: Contexts Are More Important Than the Number of Parameters

abstract: Adapter-tuning is a paradigm that transfers a pretrained language model to downstream tasks by adding and tuning a small number of new parameters. Previously proposed adapter architectures are all feed-forward neural networks. In this paper, we investigate the effectiveness of using tiny-attention -- i.e., attention with extremely small per-head dimensionality -- as adapters. Our tiny-attention adapter learns to modify the hidden states at each position directly conditioned on the hidden states at all the other positions, which is missed by the previously proposed adapters. Moreover, we view its multiple attention heads as a mixture of experts and propose to average their weights during deployment, which further reduces its inference computation cost. On the GLUE benchmark, our tiny-attention adapter outperforms the other parameter-efficient transfer learning methods as well as full fine-tuning while only updating 0.05% of the parameters. On the FewGLUE benchmark, its performance is comparable to that of GPT-3 and PET.


title: Learning to Configure Computer Networks with Neural Algorithmic Reasoning

abstract: We present a new method for scaling automatic configuration of computer networks. The key idea is to relax the computationally hard search problem of finding a configuration that satisfies a given specification into an approximate objective amenable to learning-based techniques. Based on this idea, we train a neural algorithmic model which learns to generate configurations likely to (fully or partially) satisfy a given specification under existing routing protocols. By relaxing the rigid satisfaction guarantees, our approach (i) enables greater flexibility: it is protocol-agnostic, enables cross-protocol reasoning, and does not depend on hardcoded rules; and (ii) finds configurations for much larger computer networks than previously possible. Our learned synthesizer is up to 490x faster than state-of-the-art SMT-based methods, while producing configurations which on average satisfy more than 93% of the provided requirements.


title: Topic Taxonomy Expansion via Hierarchy-Aware Topic Phrase Generation

abstract: Topic taxonomies display hierarchical topic structures of a text corpus and provide topical knowledge to enhance various NLP applications. To dynamically incorporate new topic information, several recent studies have tried to expand (or complete) a topic taxonomy by inserting emerging topics identified in a set of new documents. However, existing methods focus only on frequent terms in documents and the local topic-subtopic relations in a taxonomy, which leads to limited topic term coverage and fails to model the global topic hierarchy. In this work, we propose a novel framework for topic taxonomy expansion, named TopicExpan, which directly generates topic-related terms belonging to new topics. Specifically, TopicExpan leverages the hierarchical relation structure surrounding a new topic and the textual content of an input document for topic term generation. This approach encourages newly-inserted topics to further cover important but less frequent terms as well as to keep their relation consistency within the taxonomy. Experimental results on two real-world text corpora show that TopicExpan significantly outperforms other baseline methods in terms of the quality of output taxonomies.


title: Fast integrators with sensitivity propagation for use in CasADi

abstract: Efficient integrators with sensitivity propagation are an essential ingredient for the numerical solution of optimal control problems. This paper gives an overview on the acados integrators, their Python interface and presents a workflow that allows using them with their sensitivities within a nonlinear programming (NLP) solver interfaced by CasADi. The implementation is discussed, demonstrated and provided as open-source software. The computation times of the proposed integrator and its sensitivity computation are compared to the native CasADi collocation integrator, CVODES and IDAS on different examples. A speedup of one order of magnitude for simulation and of up to three orders of magnitude for the forward sensitivity propagation is shown for an airborne wind energy system model.


title: Order and density fluctuations near the boundary in sheared dense suspensions

abstract: We introduce a novel approach to reveal ordering fluctuations in sheared dense suspensions, using line scanning in a combined rheometer and laser scanning confocal microscope. We validate the technique with a moderately dense suspension, observing modest shear-induced ordering and a nearly linear flow profile. At high concentration ($\phi = 0.55$) and applied stress just below shear thickening, we report ordering fluctuations with high temporal resolution, and directly measure a decrease in order with distance from the suspension's bottom boundary as well as a direct correlation between order and particle concentration. Higher applied stress produces shear thickening with large fluctuations in boundary stress which we find are accompanied by dramatic fluctuations in suspension flow speeds. The peak flow rates are independent of distance from the suspension boundary, indicating that they likely arise from transient jamming that creates solid-like aggregates of particles moving together, but only briefly because the high speed fluctuations are interspersed with regions flowing much more slowly, suggesting that shear thickening suspensions possess complex internal structural dynamics, even in relatively simple geometries.


title: Sybil-Proof Diffusion Auction in Social Networks

abstract: A diffusion auction is a market to sell commodities over a social network, where the challenge is to incentivize existing buyers to invite their neighbors in the network to join the market. Existing mechanisms have been designed to solve the challenge in various settings, aiming at desirable properties such as non-deficiency, incentive compatibility and social welfare maximization. Since the mechanisms are employed in dynamic networks with ever-changing structures, buyers could easily generate fake nodes in the network to manipulate the mechanisms for their own benefits, which is commonly known as the Sybil attack. We observe that strategic agents may gain an unfair advantage in existing mechanisms through such attacks. To resist this potential attack, we propose two diffusion auction mechanisms, the Sybil tax mechanism (STM) and the Sybil cluster mechanism (SCM), to achieve both Sybil-proofness and incentive compatibility in the single-item setting. Our proposal provides the first mechanisms to protect the interests of buyers against Sybil attacks with a mild sacrifice of social welfare and revenue.


title: Notes on Hardy's Uncertainty Principle for the Wigner distribution and Schr\"{o}dinger evolutions

abstract: We consider Schr\"{o}dinger equations with real quadratic Hamiltonians, for which the Wigner distribution of the solution at a given time equals, up to a linear coordinate transformation, the Wigner distribution of the initial condition. Based on Hardy's uncertainty principle for the joint time-frequency representation, we prove a uniqueness result for such Schr\"{o}dinger equations, where the solution cannot have strong decay at two distinct times. This approach reproduces known, sharp results for the free Schr\"{o}dinger equation and the harmonic oscillator, and we also present an explicit scheme for quadratic systems based on positive definite matrices.


title: Resilience of cube slicing in $\ell_p$

abstract: Ball's celebrated cube slicing (1986) asserts that among hyperplane sections of the cube in $\mathbb{R}^n$, the central section orthogonal to $(1,1,0,\dots,0)$ has the greatest volume. We show that the same continues to hold for slicing $\ell_p$ balls when $p > 10^{15}$, as well as that the same hyperplane minimizes the volume of projections of $\ell_q$ balls for $1 < q < 1 + 10^{-12}$. This extends Szarek's optimal Khinchin inequality (1976) which corresponds to $q=1$. These results thus address the resilience of the Ball--Szarek hyperplane in the ranges $2 < p < \infty$ and $1 < q < 2$, where analysis of the extremizers has been elusive since the works of Koldobsky (1998), Barthe--Naor (2002) and Oleszkiewicz (2003).


title: Exact calculation of quantizer constants for arbitrary lattices

abstract: We present an algorithm for the exact computer-aided construction of the Voronoi cells of lattices with known symmetry group. Our algorithm scales better than linearly with the total number of faces and is applicable to dimensions beyond 12, which previous methods could not achieve. The new algorithm is applied to the Coxeter-Todd lattice $K_{12}$ as well as to a family of lattices obtained from laminating $K_{12}$. By optimizing this family, we obtain a new best 13-dimensional lattice quantizer (among the lattices with published exact quantizer constants).


title: End-point Norm Estimates for Ces\`aro and Copson Operators

abstract: For a large class of operators acting between weighted $\ell^\infty$ spaces, exact formulas are given for their norms and the norms of their restrictions to the cones of nonnegative sequences; nonnegative, nonincreasing sequences; and nonnegative, nondecreasing sequences. The weights involved are arbitrary nonnegative sequences and may differ in the domain and codomain spaces. The results are applied to the Ces\`aro and Copson operators, giving their norms and their distances to the identity operator on the whole space and on the cones. Simplifications of these formulas are derived in the case of these operators acting on power-weighted $\ell^\infty$. As an application, best constants are given for inequalities relating the weighted $\ell^\infty$ norms of the Ces\`aro and Copson operators both for general weights and for power weights.


title: Bound states of weakly deformed soft waveguides

abstract: In this paper we consider the two-dimensional Schr\"odinger operator with an attractive potential which is a multiple of the characteristic function of an unbounded strip-shaped region, whose thickness is varying and is determined by the function $\mathbb{R}\ni x \mapsto d+\varepsilon f(x)$, where $d > 0$ is a constant, $\varepsilon > 0$ is a small parameter, and $f$ is a compactly supported continuous function. We prove that if $\int_{\mathbb{R}} f \,\mathsf{d} x > 0$, then the respective Schr\"odinger operator has a unique simple eigenvalue below the threshold of the essential spectrum for all sufficiently small $\varepsilon >0$ and we obtain the asymptotic expansion of this eigenvalue in the regime $\varepsilon\rightarrow 0$. An asymptotic expansion of the respective eigenfunction as $\varepsilon\rightarrow 0$ is also obtained. In the case that $\int_{\mathbb{R}} f \,\mathsf{d} x < 0$ we prove that the discrete spectrum is empty for all sufficiently small $\varepsilon > 0$. In the critical case $\int_{\mathbb{R}} f \,\mathsf{d} x = 0$, we derive a sufficient condition for the existence of a unique bound state for all sufficiently small $\varepsilon > 0$.


title: Membership in moment cones and quiver semi-invariants for bipartite quivers

abstract: Let $Q$ be a bipartite quiver with vertex set $Q_0$ such that the number of arrows between any two source and sink vertices is constant. Let $\beta=(\beta(x))_{x \in Q_0}$ be a dimension vector of $Q$ with positive integer coordinates, and let $\Delta(Q, \beta)$ be the moment cone associated to $(Q, \beta)$. We show that the membership problem for $\Delta(Q, \beta)$ can be solved in strongly polynomial time. As a key step in our approach, we first solve the polytopal problem for semi-invariants of $Q$ and its flag-extensions. Specifically, let $Q_{\beta}$ be the flag-extension of $Q$ obtained by attaching a flag $\mathcal{F}(x)$ of length $\beta(x)-1$ at every vertex $x$ of $Q$, and let $\widetilde{\beta}$ be the extension of $\beta$ to $Q_{\beta}$ that takes values $1, \ldots, \beta(x)$ along the vertices of the flag $\mathcal{F}(x)$ for every vertex $x$ of $Q$. For an integral weight $\widetilde{\sigma}$ of $Q_{\beta}$, let $K_{\widetilde{\sigma}}$ be the dimension of the space of semi-invariants of weight $\widetilde{\sigma}$ on the representation space of $\widetilde{\beta}$-dimensional complex representations of $Q_{\beta}$. We show that $K_{\widetilde{\sigma}}$ can be expressed as the number of lattice points of a certain hive-type polytope. This polytopal description together with Derksen-Weyman's Saturation Theorem for quiver semi-invariants allows us to use Tardos's algorithm to solve the membership problem for $\Delta(Q,\beta)$ in strongly polynomial time.


title: Leveraging Fully Observable Policies for Learning under Partial Observability

abstract: Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a method for partially observable reinforcement learning that uses a fully observable policy (which we call a state expert) during offline training to improve online performance. Based on Soft Actor-Critic (SAC), our agent balances performing actions similar to the state expert and getting high returns under partial observability. Our approach can leverage the fully-observable policy for exploration and parts of the domain that are fully observable while still being able to learn under partial observability. On six robotics domains, our method outperforms pure imitation, pure reinforcement learning, the sequential or parallel combination of both types, and a recent state-of-the-art method in the same setting. A successful policy transfer to a physical robot in a manipulation task from pixels shows our approach's practicality in learning interesting policies under partial observability.


title: Characterizing Virtual Reality Software Testing

abstract: Virtual Reality (VR) is an emerging technique that provides a unique real-time experience for users. VR technologies have provided revolutionary user experiences in various scenarios (e.g., training, education, product/architecture design, gaming, remote conference/tour, etc.). However, testing VR applications is challenging due to their nature which necessitates physical interactivity, and their reliance on hardware systems. Despite the recent advancements in VR technology and its usage scenarios, we still know little about VR application testing. To fill up this knowledge gap, we performed an empirical study on 97 open-source VR applications including 28 industrial projects. Our analysis identified that 74.2% of the VR projects evaluated did not have any tests, and for the VR projects that did, the median functional-method to test-method ratio was low in comparison to other project categories. Moreover, we uncovered tool support issues concerning the measurement of VR code coverage, and the code coverage and assertion density results we were able to generate were also relatively low, as they respectively had averages of 15.63% and 17.69%. Finally, through manual analysis of 220 test cases from four VR applications and 281 test cases from four non-VR applications, we identified that VR applications require specific categories of test cases to ensure VR application quality attributes. We believe that our findings constitute a call to action for the VR development community to improve testing aspects and provide directions for software engineering researchers to develop advanced techniques for automatic test case generation and test quality analysis for VR applications.


title: Probing Statistical Representations For End-To-End ASR

abstract: End-to-End automatic speech recognition (ASR) models aim to learn a generalised speech representation to perform recognition. In this domain there is little research to analyse internal representation dependencies and their relationship to modelling approaches. This paper investigates cross-domain language model dependencies within transformer architectures using SVCCA and uses these insights to exploit modelling approaches. It was found that specific neural representations within the transformer layers exhibit correlated behaviour which impacts recognition performance. Altogether, this work provides analysis of the modelling approaches affecting contextual dependencies and ASR performance, and can be used to create or adapt better performing End-to-End ASR models and also for downstream tasks.


title: lilGym: Natural Language Visual Reasoning with Reinforcement Learning

abstract: We present lilGym, a new benchmark for language-conditioned reinforcement learning in visual environments. lilGym is based on 2,661 highly-compositional human-written natural language statements grounded in an interactive visual environment. We introduce a new approach for exact reward computation in every possible world state by annotating all statements with executable Python programs. Each statement is paired with multiple start states and reward functions to form thousands of distinct Markov Decision Processes of varying difficulty. We experiment with lilGym with different models and learning regimes. Our results and analysis show that while existing methods are able to achieve non-trivial performance, lilGym forms a challenging open problem. lilGym is available at https://lil.nlp.cornell.edu/lilgym/.


title: Computing zero-group-velocity points in anisotropic elastic waveguides: Globally and locally convergent methods

abstract: Dispersion curves of elastic waveguides exhibit points where the group velocity vanishes while the wavenumber remains finite. These are the so-called zero-group-velocity (ZGV) points. As the elastodynamic energy at these points remains confined close to the source, they are of practical interest for nondestructive testing and quantitative characterization of structures. These applications rely on the correct prediction of the ZGV points. In this contribution, we first model the ZGV resonances in anisotropic plates based on the appearance of an additional modal solution. The resulting governing equation is interpreted as a two-parameter eigenvalue problem. Subsequently, we present three complementary numerical procedures capable of computing ZGV points in arbitrary nondissipative elastic waveguides in the conventional sense that their axial power flux vanishes. The first method is globally convergent and guarantees to find all ZGV points but can only be used for small problems. The second procedure is a very fast, generally-applicable, Newton-type iteration that is locally convergent and requires initial guesses. The third method combines both kinds of approaches and yields a procedure that is applicable to large problems, does not require initial guesses and is likely to find all ZGV points. The algorithms are implemented in "GEW ZGV computation" (doi: 10.5281/zenodo.7537442).


title: A remark on the Hochschild dimension of liberated quantum groups

abstract: Let $A$ be a Hopf algebra equipped with a projection onto the coordinate Hopf algebra $\mathcal{O}(G)$ of a semisimple algebraic group $G$. It is shown that if $A$ admits a suitably non-degenerate comodule $V$ and the induced $G$-module structure of $V$ is non-trivial, then the third Hochschild homology group of $A$ is non-trivial.


title: Extremely Narrow, Sharp-Peaked Resonances at the Edge of the Continuum

abstract: We report a critical narrowing of resonances of a driven potential well, when their eigenfrequencies approach the edge of the continuum. The resonances also obtain unusual sharp-peak shapes at the continuum boundary. The situation can be realized for the electromagnetic wave propagating across the dielectric thin films with a periodically modulated interface(s). We show the general phenomenon semi-analytically on a simplified model of a driven quantum potential well, also by rigorous numerical analysis of Maxwell equations for the wave propagation across the thin film with a modulated interface(s). We justify the phenomenon experimentally, by the measurements of light reflection from the dielectric thin film deposited on a periodically modulated surface. The narrow and sharp-peak resonances can be used for an efficient narrow-band frequency- and spatial filtering of light.


title: Driving innovation through project based learning: A pre-university STEAM for Social Good initiative

abstract: The Covid pandemic is a clarion call for increased sensitivity to the interconnected nature of social problems facing our world today. A future-oriented education on critical issues, such as those outlined in the United Nations Sustainable Development Goals (UN SDGs) and designing potential solutions for such problems is an imperative skill that must be imparted to children to help them navigate their future in today's unpredictable world. Towards this goal, we have been conducting 3.5 month-long mentoring programs for pre-university students in India to participate in a STEAM for Social Good innovation challenge conducted annually by the Government of India. Using digital and physical computing skills, we helped children explore creative solutions for social problems through a constructionist approach to learning, wherein they ideated and reflected upon the problems in their communities. The children learnt the Engineering Design Thinking process and worked in online groups of two or three, from concept to completion. Despite the constraints posed by the pandemic, they explored creative ways to think about design and innovation. They completed a variety of tasks by making, tinkering, engineering, assembling, and programming to grasp the intricate relationship between software and hardware. Subsequently, the children showcased their creative abilities through video storytelling to a panel of domain experts. In this paper, we present the children's perspective of their experiences through this journey, the evaluation metrics based on IEEE design principles, and our learnings from conducting this initiative as a university-school partnership model for 84 middle and high school students. The aspirational intent of this initiative is to make the children better social problem solvers and help them perceive social problems as opportunities to enhance life for themselves and their communities.


title: Quantifying Model Uncertainty for Semantic Segmentation using Operators in the RKHS

abstract: Deep learning models for semantic segmentation are prone to poor performance in real-world applications due to the highly challenging nature of the task. Model uncertainty quantification (UQ) is one way to address this issue of lack of model trustworthiness by enabling the practitioner to know how much to trust a segmentation output. Current UQ methods in this application domain are mainly restricted to Bayesian based methods which are computationally expensive and are only able to extract central moments of uncertainty thereby limiting the quality of their uncertainty estimates. We present a simple framework for high-resolution predictive uncertainty quantification of semantic segmentation models that leverages a multi-moment functional definition of uncertainty associated with the model's feature space in the reproducing kernel Hilbert space (RKHS). The multiple uncertainty functionals extracted from this framework are defined by the local density dynamics of the model's feature space and hence automatically align themselves at the tail-regions of the intrinsic probability density function of the feature space (where uncertainty is the highest) in such a way that the successively higher order moments quantify the more uncertain regions. This leads to a significantly more accurate view of model uncertainty than conventional Bayesian methods. Moreover, the extraction of such moments is done in a single-shot computation making it much faster than Bayesian and ensemble approaches (that involve a high number of forward stochastic passes of the model to quantify its uncertainty). We demonstrate these advantages through experimental evaluations of our framework implemented over four different state-of-the-art model architectures that are trained and evaluated on two benchmark road-scene segmentation datasets (Camvid and Cityscapes).


title: Dynamic Kernels and Channel Attention for Low Resource Speaker Verification

abstract: State-of-the-art speaker verification frameworks have typically focused on developing models with increasingly deeper (more layers) and wider (number of channels) models to improve their verification performance. Instead, this paper proposes an approach to increase the model resolution capability using attention-based dynamic kernels in a convolutional neural network to adapt the model parameters to be feature-conditioned. The attention weights on the kernels are further distilled by channel attention and multi-layer feature aggregation to learn global features from speech. This approach provides an efficient solution to improving representation capacity with lower data resources. This is due to the self-adaptation to inputs of the structures of the model parameters. The proposed dynamic convolutional model achieved 1.62\% EER and 0.18 miniDCF on the VoxCeleb1 test set and has a 17\% relative improvement compared to the ECAPA-TDNN using the same training resources.


title: Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model

abstract: Progress in machine learning (ML) comes with a cost to the environment, given that training ML models requires significant computational resources, energy and materials. In the present article, we aim to quantify the carbon footprint of BLOOM, a 176-billion parameter language model, across its life cycle. We estimate that BLOOM's final training emitted approximately 24.7 tonnes of~\carboneq~if we consider only the dynamic power consumption, and 50.5 tonnes if we account for all processes ranging from equipment manufacturing to energy-based operational consumption. We also study the energy requirements and carbon emissions of its deployment for inference via an API endpoint receiving user queries in real-time. We conclude with a discussion regarding the difficulty of precisely estimating the carbon footprint of ML models and future research directions that can contribute towards improving carbon emissions reporting.


title: Emergence of Competing Orders and Possible Quantum Spin Liquid in SU(N) Fermions

abstract: In the past decades, tremendous efforts have been made towards understanding the exotic physics emerging from competition between various ordering tendencies in strongly correlated systems. Employing state-of-the-art quantum Monte-Carlo simulation, we investigate an interacting SU($N$) fermionic model with varying interaction strength and value of $N$, and unveil the ground-state phase diagram of the model exhibiting a plethora of exotic phases. For small value of $N$, namely $N=2,3$, the ground state is antiferromagnetic (AFM) phase, whereas in the large-$N$ limit, valence bound solid (VBS) order is dominant. For the intermediate value of $N$ such as $N=4$, remarkably, our study reveals distinct VBS orders appear in the weak and strong coupling regimes. More fantastically, the competition between staggered and columnar VBS ordering tendencies gives rise to a Mott insulating phase without spontaneously symmetry breaking (SSB), existing in a large interacting parameter regime, which is consistent with a gapped quantum spin liquid. Our study not only provides a platform to investigate the fundamental physics of quantum many-body systems, but also offers a novel route towards searching for exotic states of matter such as quantum spin liquid in realistic quantum materials.


title: Distributed DP-Helmet: Scalable Differentially Private Non-interactive Averaging of Single Layers

abstract: In this work, we propose two differentially private, non-interactive, distributed learning algorithms in a framework called Distributed DP-Helmet. Our framework is based on what we coin blind averaging: each user locally learns and noises a model and all users then jointly compute the mean of their models via a secure summation protocol. We provide experimental evidence that blind averaging for SVMs and single Softmax-layer (Softmax-SLP) can have a strong utility-privacy tradeoff: we reach an accuracy of 86% on CIFAR-10 for $\varepsilon$ = 0.4 and 1,000 users, of 44% on CIFAR-100 for $\varepsilon$ = 1.2 and 100 users, and of 39% on federated EMNIST for $\varepsilon$ = 0.4 and 3,400 users, all after a SimCLR-based pretraining. As an ablation, we study the resilience of our approach to a strongly non-IID setting. On the theoretical side, we show that blind averaging preserves differential privacy if the objective function is smooth, Lipschitz, and strongly convex like SVMs. We show that these properties also hold for Softmax-SLP which is often used for last-layer fine-tuning such that for a fixed model size the privacy bound $\varepsilon$ of Softmax-SLP no longer depends on the number of classes. This marks a significant advantage in utility and privacy of Softmax-SLP over SVMs. Furthermore, in the limit blind averaging of hinge-loss SVMs convergences to a centralized learned SVM. The latter result is based on the representer theorem and can be seen as a blueprint for finding convergence for other empirical risk minimizers (ERM) like Softmax-SLP.


title: Truthful Matching with Online Items and Offline Agents

abstract: We study truthful mechanisms for welfare maximization in online bipartite matching. In our (multi-parameter) setting, every buyer is associated with a (possibly private) desired set of items, and has a private value for being assigned an item in her desired set. Unlike most online matching settings, where agents arrive online, in our setting the items arrive online in an adversarial order while the buyers are present for the entire duration of the process. This poses a significant challenge to the design of truthful mechanisms, due to the ability of buyers to strategize over future rounds. We provide an almost full picture of the competitive ratios in different scenarios, including myopic vs. non-myopic agents, tardy vs. prompt payments, and private vs. public desired sets. Among other results, we identify the frontier for which the celebrated $e/(e-1)$ competitive ratio for the vertex-weighted online matching of Karp, Vazirani and Vazirani extends to truthful agents and online items.


title: Robust Dependence Measure using RKHS based Uncertainty Moments and Optimal Transport

abstract: Reliable measurement of dependence between variables is essential in many applications of statistics and machine learning. Current approaches for dependence estimation, especially density-based approaches, lack in precision, robustness and/or interpretability (in terms of the type of dependence being estimated). We propose a two-step approach for dependence quantification between random variables: 1) We first decompose the probability density functions (PDF) of the variables involved in terms of multiple local moments of uncertainty that systematically and precisely identify the different regions of the PDF (with special emphasis on the tail-regions). 2) We then compute an optimal transport map to measure the geometric similarity between the corresponding sets of decomposed local uncertainty moments of the variables. Dependence is then determined by the degree of one-to-one correspondence between the respective uncertainty moments of the variables in the optimal transport map. We utilize a recently introduced Gaussian reproducing kernel Hilbert space (RKHS) based framework for multi-moment uncertainty decomposition of the variables. Being based on the Gaussian RKHS, our approach is robust towards outliers and monotone transformations of data, while the multiple moments of uncertainty provide high resolution and interpretability of the type of dependence being quantified. We support these claims through some preliminary results using simulated data.


title: SAP-DETR: Bridging the Gap Between Salient Points and Queries-Based Transformer Detector for Fast Model Convergency

abstract: Recently, the dominant DETR-based approaches apply central-concept spatial prior to accelerate Transformer detector convergency. These methods gradually refine the reference points to the center of target objects and imbue object queries with the updated central reference information for spatially conditional attention. However, centralizing reference points may severely deteriorate queries' saliency and confuse detectors due to the indiscriminative spatial prior. To bridge the gap between the reference points of salient queries and Transformer detectors, we propose SAlient Point-based DETR (SAP-DETR) by treating object detection as a transformation from salient points to instance objects. In SAP-DETR, we explicitly initialize a query-specific reference point for each object query, gradually aggregate them into an instance object, and then predict the distance from each side of the bounding box to these points. By rapidly attending to query-specific reference region and other conditional extreme regions from the image features, SAP-DETR can effectively bridge the gap between the salient point and the query-based Transformer detector with a significant convergency speed. Our extensive experiments have demonstrated that SAP-DETR achieves 1.4 times convergency speed with competitive performance. Under the standard training scheme, SAP-DETR stably promotes the SOTA approaches by 1.0 AP. Based on ResNet-DC-101, SAP-DETR achieves 46.9 AP.


title: A Bayesian inference of relativistic mean-field model for neutron star matter from observation of NICER and GW170817/AT2017gfo

abstract: The observations of optical and near-infrared counterparts of binary neutron star mergers not only enrich our knowledge about the abundance of heavy elements in the Universe, or help reveal the remnant object just after the merger as generally known, but also can effectively constrain dense nuclear matter properties and the equation of state (EOS) in the interior of the merging stars. Following the relativistic mean-field description of nuclear matter, we perform the Bayesian inference of the EOS and the nuclear matter properties using the first multi-messenger event GW170817/AT2017gfo, together with the NICER mass-radius measurements of pulsars. The kilonova is described by a radiation-transfer model with the dynamical ejecta, and light curves connect with the EOS through the quasi-universal relations between the ejecta properties (the ejected mass, velocity, opacity or electron fraction) and binary parameters (the mass ratio and reduced tidal deformability). It is found that the posterior distributions of the reduced tidal deformability from the AT2017gfo analysis display a bimodal structure, with the first peak enhanced by the GW170817 data, leading to slightly softened posterior EOSs, while the second peak cannot be achieved by a nuclear EOS with saturation properties in their empirical ranges. The inclusion of NICER data in our analyses results in stiffened EOS posterior because of the massive pulsar PSR J0740+6620. We give results at nuclear saturation density for the nuclear incompressibility, the symmetry energy and its slope, as well as the nucleon effective mass, from our analysis of those observational data.


title: Orbital Motion of a test particle around a Schwarzschild's Black Hole in STVG gravity

abstract: In this article, we have examined the existence of a static spherically symmetric solution in the Scalar Tensor Vector Gravity (STVG) and investigated its horizon distances to develop boundary limitations for our test particle. We have computed the Kretschmann invariant of the metric to study the singularities and verify that it reduces to general relativity's Kretschmann invariant as $\alpha\rightarrow0$. Further, we investigated the orbital motion of a time-like and light-like test particle around the static solution by developing an effective potential and the radius of the innermost stable circular orbit (ISCO).


title: Normal approximation of Kabanov-Skorohod integrals on Poisson spaces

abstract: We consider the normal approximation of Kabanov-Skorohod integrals on a general Poisson space. Our bounds are for the Wasserstein and the Kolmogorov distance and involve only difference operators of the integrand of the Kabanov-Skorohod integral. The proofs rely on the Malliavin-Stein method and, in particular, on multiple applications of integration by parts formulae. As examples, we study some linear statistics of point processes that can be constructed by Poisson embeddings and functionals related to Pareto optimal points of a Poisson process.


title: On ALP scenarios and GRB 221009A

abstract: The extraordinarily bright gamma-ray burst GRB 221009A was observed by a large number of observatories, from radio frequencies to gamma-rays. Of particular interest are the reported observations of photon-like air showers of very high energy: an 18 TeV event in LHAASO and a 251 TeV event at Carpet-2. Gamma rays at these energies are expected to be absorbed by pair-production events on background photons when travelling intergalactic distances. Several works have sought to explain the observations of these events, assuming they originate from GRB 221009A, by invoking axion-like particles (ALPs). We reconsider this scenario and account for astrophysical uncertainties due to poorly known magnetic fields and background photon densities. We find that, robustly, the ALP scenario cannot simultaneously account for an 18 TeV and a 251 TeV photon from GRB 221009A.


title: Inverse scaling can become U-shaped

abstract: Scaling up language models has been empirically shown to improve performance on a wide range of downstream tasks. However, if we were to observe worse performance as a function of scale ("inverse scaling") on certain tasks, this would indicate that scaling can also encourage behaviors that are misaligned with human preferences. The Inverse Scaling Prize (McKenzie et al. 2022) identified eleven such inverse scaling tasks, evaluated on models of up to 280B parameters and up to 500 zettaFLOPs of training compute. This paper takes a closer look at these inverse scaling tasks. We evaluate models of up to 540B parameters, trained on five times more compute than those evaluated in the Inverse Scaling Prize. With this increased range of model sizes and training compute, only four out of the eleven tasks remain inverse scaling. Six out of the eleven tasks exhibit "U-shaped scaling", where performance decreases up to a certain size, and then increases again up to the largest model evaluated (the one remaining task displays positive scaling). In addition, we find that 1-shot examples and chain-of-thought can help mitigate undesirable scaling patterns even further. U-shaped scaling suggests that the inverse scaling trend observed in McKenzie et al. (2022) may not continue to hold for larger models, which we attribute to the presence of distractor tasks that only sufficiently large models can avoid.


title: Optimal Compression for Minimizing Classification Error Probability: an Information-Theoretic Approach

abstract: We formulate the problem of performing optimal data compression under the constraints that compressed data can be used for accurate classification in machine learning. We show that this translates to a problem of minimizing the mutual information between data and its compressed version under the constraint on error probability of classification is small when using the compressed data for machine learning. We then provide analytical and computational methods to characterize the optimal trade-off between data compression and classification error probability. First, we provide an analytical characterization for the optimal compression strategy for data with binary labels. Second, for data with multiple labels, we formulate a set of convex optimization problems to characterize the optimal tradeoff, from which the optimal trade-off between the classification error and compression efficiency can be obtained by numerically solving the formulated optimization problems. We further show the improvements of our formulations over the information-bottleneck methods in classification performance.


title: Analyzing Performance Issues of Virtual Reality Applications

abstract: Extended Reality (XR) includes Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR). XR is an emerging technology that simulates a realistic environment for users. XR techniques have provided revolutionary user experiences in various application scenarios (e.g., training, education, product/architecture design, gaming, remote conference/tour, etc.). Due to the high computational cost of rendering real-time animation in limited-resource devices and constant interaction with user activity, XR applications often face performance bottlenecks, and these bottlenecks create a negative impact on the user experience of XR software. Thus, performance optimization plays an essential role in many industry-standard XR applications. Even though identifying performance bottlenecks in traditional software (e.g., desktop applications) is a widely explored topic, those approaches cannot be directly applied within XR software due to the different nature of XR applications. Moreover, XR applications developed in different frameworks such as Unity and Unreal Engine show different performance bottleneck patterns and thus, bottleneck patterns of Unity projects can't be applied for Unreal Engine (UE)-based XR projects. To fill the knowledge gap for XR performance optimizations of Unreal Engine-based XR projects, we present the first empirical study on performance optimizations from seven UE XR projects, 78 UE XR discussion issues and three sources of UE documentation. Our analysis identified 14 types of performance bugs, including 12 types of bugs related to UE settings issues and two types of CPP source code-related issues. To further assist developers in detecting performance bugs based on the identified bug patterns, we also developed a static analyzer, UEPerfAnalyzer, that can detect performance bugs in both configuration files and source code.


title: On the classicality of quantum dephasing processes

abstract: We analyze the multitime statistics associated with pure dephasing systems repeatedly probed with sharp measurements, and search for measurement protocols whose statistics satisfies the Kolmogorov consistency conditions possibly up to a finite order. We find a rich phenomenology of quantum dephasing processes which can be interpreted in classical terms. In particular, if the underlying dephasing process is Markovian, we find sufficient conditions under which classicality at every order can be found: this can be reached by choosing the dephasing and measurement basis to be fully compatible or fully incompatible, that is, mutually unbiased bases (MUBs). For non-Markovian processes, classicality can only be proven in the fully compatible case, thus revealing a key difference between Markovian and non-Markovian pure dephasing processes.


title: On the Tur\'an number of the hypercube

abstract: In 1964, Erd\H{o}s proposed the problem of estimating the Tur\'an number of the $d$-dimensional hypercube $Q_d$. Since $Q_d$ is a bipartite graph with maximum degree $d$, it follows from results of F\"uredi and Alon, Krivelevich, Sudakov that $\mathrm{ex}(n,Q_d)=O_d(n^{2-1/d})$. A recent general result of Sudakov and Tomon implies the slightly stronger bound $\mathrm{ex}(n,Q_d)=o(n^{2-1/d})$. We obtain the first power-improvement for this old problem by showing that $\mathrm{ex}(n,Q_d)=O_d(n^{2-\frac{1}{d-1}+\frac{1}{(d-1)2^{d-1}}})$. This answers a question of Liu. Moreover, our techniques give a power improvement for a larger class of graphs than cubes. We use a similar method to prove that any $n$-vertex, properly edge-coloured graph without a rainbow cycle has at most $O(n(\log n)^2)$ edges, improving the previous best bound of $n(\log n)^{2+o(1)}$ by Tomon. Furthermore, we show that any properly edge-coloured $n$-vertex graph with $\omega(n\log n)$ edges contains a cycle which is almost rainbow: that is, almost all edges in it have a unique colour. This latter result is tight.


title: Oracle Inequalities for Model Selection in Offline Reinforcement Learning

abstract: In offline reinforcement learning (RL), a learner leverages prior logged data to learn a good policy without interacting with the environment. A major challenge in applying such methods in practice is the lack of both theoretically principled and practical tools for model selection and evaluation. To address this, we study the problem of model selection in offline RL with value function approximation. The learner is given a nested sequence of model classes to minimize squared Bellman error and must select among these to achieve a balance between approximation and estimation error of the classes. We propose the first model selection algorithm for offline RL that achieves minimax rate-optimal oracle inequalities up to logarithmic factors. The algorithm, ModBE, takes as input a collection of candidate model classes and a generic base offline RL algorithm. By successively eliminating model classes using a novel one-sided generalization test, ModBE returns a policy with regret scaling with the complexity of the minimally complete model class. In addition to its theoretical guarantees, it is conceptually simple and computationally efficient, amounting to solving a series of square loss regression problems and then comparing relative square loss between classes. We conclude with several numerical simulations showing it is capable of reliably selecting a good model class.


title: A cryogenic SRAM based arbitrary waveform generator in 14 nm for spin qubit control

abstract: Realization of qubit gate sequences require coherent microwave control pulses with programmable amplitude, duration, spacing and phase. We propose an SRAM based arbitrary waveform generator for cryogenic control of spin qubits. We demonstrate in this work, the cryogenic operation of a fully programmable radio frequency arbitrary waveform generator in 14 nm FinFET technology. The waveform sequence from a control processor can be stored in an SRAM memory array, which can be programmed in real time. The waveform pattern is converted to microwave pulses by a source-series-terminated digital to analog converter. The chip is operational at 4 K, capable of generating an arbitrary envelope shape at the desired carrier frequency. Total power consumption of the AWG is 40-140mW at 4 K, depending upon the baud rate. A wide signal band of 1-17 GHz is measured at 4 K, while multiple qubit control can be achieved using frequency division multiplexing at an average spurious free dynamic range of 40 dB. This work paves the way to optimal qubit control and closed loop feedback control, which is necessary to achieve low latency error mitigation


title: A unconditionally energy dissipative, adaptive IMEX BDF2 scheme and its error estimates for Cahn-Hilliard equation on generalized SAV approach

abstract: An adaptive implicit-explicit (IMEX) BDF2 scheme is investigated on generalized SAV approach for the Cahn-Hilliard equation by combining with Fourier spectral method in space. It is proved that the modified energy dissipation law is unconditionally preserved at discrete levels. Under a mild ratio restriction, i.e., \Ass{1}: $0<r_k:=\tau_k/\tau_{k-1}< r_{\max}\approx 4.8645$, we establish a rigorous error estimate in $H^1$-norm and achieve optimal second-order accuracy in time. The proof involves the tools of discrete orthogonal convolution (DOC) kernels and inequality zoom. It is worth noting that the presented adaptive time-step scheme only requires solving one linear system with constant coefficients at each time step. In our analysis, the first-consistent BDF1 for the first step does not bring the order reduction in $H^1$-norm. The $H^1$ bound of the numerical solution under periodic boundary conditions can be derived without any restriction (such as zero mean of the initial data). Finally, numerical examples are provided to verify our theoretical analysis and the algorithm efficiency.


title: Extending the analogy between intracellular motion in mammalian cells and glassy dynamics

abstract: The physics of how molecules, organelles, and foreign objects move within living cells has been extensively studied in organisms ranging from bacteria to human cells. In mammalian cells, in particular, cellular vesicles move across the cell using motor proteins that carry the vesicle down the cytoskeleton to their destination. We have recently noted several similarities between the motion of such vesicles and that in disordered, "glassy", systems, but it remains unclear whether that is a general observation or something specific to certain vesicles in one particular cell type. Here we follow the motion of mitochondria, the organelles responsible for cell energy production, in several mammalian cell types over timescales ranging from 50 ms up to 70 s. Qualitative observations show that single mitochondria remain stalled, remaining within a spatially limited region, for extended periods of time, before moving longer distances relatively quickly. Analysing this motion quantitatively, we observe a displacement distribution that is roughly Gaussian for shorter distances ($\lesssim$ 0.05 $\mu$m) but which exhibits exponentially decaying tails at longer distances (up to 0.40 $\mu$m). We show that this behaviour is well-described by a model originally developed to describe the motion in glassy systems. These observations are extended to in total 3 different objects (mitochondria, lysosomes and nano-sized beads enclosed in vesicles), 3 different mammalian cell types, from 2 different organisms (human and mouse). We provide further evidence that supports glass-like characteristics of the motion by showing a difference between the time it takes to move a longer distance for the first time and subsequent times, as well as a weak ergodicity breaking of the motion. Overall, we demonstrate the ubiquity of glass-like motion in mammalian cells, providing a different perspective on intracellular motion.


title: Bayesian Causal Forests & the 2022 ACIC Data Challenge: Scalability and Sensitivity

abstract: We demonstrate how Hahn et al.'s Bayesian Causal Forests model (BCF) can be used to estimate conditional average treatment effects for the longitudinal dataset in the 2022 American Causal Inference Conference Data Challenge. Unfortunately, existing implementations of BCF do not scale to the size of the challenge data. Therefore, we developed flexBCF -- a more scalable and flexible implementation of BCF -- and used it in our challenge submission. We investigate the sensitivity of our results to the choice of propensity score estimation method and the use of sparsity-inducing regression tree priors. While we found that our overall point predictions were not especially sensitive to these modeling choices, we did observe that running BCF with flexibly estimated propensity scores often yielded better-calibrated uncertainty intervals.


title: Foot-Sorting for Socks

abstract: If your socks come out of the laundry all mixed up, how should you sort them? We introduce and study a novel foot-sorting algorithm that uses feet to attempt to sort a sock ordering; one can view this algorithm as an analogue of Knuth's stack-sorting algorithm for set partitions. The sock orderings that can be sorted using a fixed number of feet are characterized by Klazar's notion of set partition pattern containment. We give an enumeration involving Fibonacci numbers for the $1$-foot-sortable sock orderings within a naturally-arising class. We also prove that if you have socks of $n$ different colors, then you can always sort them using at most $\left\lceil\log_2(n)\right\rceil$ feet, and we use a Ramsey-theoretic argument to show that this bound is tight.


title: Dynamical simulations of carotenoid photoexcited states using density matrix renormalization group techniques

abstract: We present a dynamical simulation scheme to model the highly correlated excited state dynamics of linear polyenes. We apply it to investigate the internal conversion processes of carotenoids following their photoexcitation. We use the extended Hubbard-Peierls model, $\hat{H}_{\textrm{UVP}}$, to describe the $\pi$-electronic system coupled to nuclear degrees of freedom supplemented by a Hamiltonian, $\hat{H}_{\epsilon}$, that explicitly breaks both the particle-hole and two-fold rotation symmetries of idealized carotenoids. The electronic degrees of freedom are treated quantum mechanically by solving the time-dependent Schr\"odinger equation using the adaptive time-dependent DMRG (tDMRG) method, while nuclear dynamics are treated via the Ehrenfest equations of motion. By defining adiabatic excited states as the eigenstates of the full Hamiltonian, $\hat{H}=\hat{H}_{\textrm{UVP}}+\hat{H}_{\epsilon}$, and diabatic excited states as eigenstates of $\hat{H}_{\textrm{UVP}}$, we present a computational framework to monitor the internal conversion process from the initial photoexcited state to the singlet triplet-pair states of carotenoids. We further incorporate Lanczos-DMRG to the tDMRG-Ehrenfest method to calculate transient absorption spectra from the evolving photoexcited state. We describe the accuracy and convergence criteria for DMRG, and show that this method accurately describes the dynamics of carotenoid excited states. We also discuss the effect of $\hat{H}_{\epsilon}$ on the internal conversion process, and show that its effect on the extent of internal conversion can be described by a Landau-Zener-type transition. This methodological paper is a companion to our more explanatory discussion of carotenoid excited state dynamics in, $\textit{Photoexcited state dynamics and singlet fission in carotenoids}$, D. Manawadu, T. N. Georges and W. Barford, $\textit{J. Phys. Chem. A}$ (2023).


title: Research on the impact of asteroid mining on global equity

abstract: In the future situation, aiming to seek more resources, human beings decided to march towards the mysterious and bright starry sky, which opened the era of great interstellar exploration. According to the Outer Space Treaty, any exploration of celestial bodies should be aimed at promoting global equality and for the benefit of all nations. Firstly, we defined global equity and set a Unified Equity Index (UEI) model to measure it. We merge the factors with greater correlation, and finally, get 6 elements, and then use the entropy method (TEM) to find the dispersion of these elements in different countries. Then use principal component analysis (PCA) to reduce the dimensionality of the dispersion, and then use the scandalized index to obtain the global equity. Secondly, we simulated a future with asteroid mining and evaluated its impact on Unified Equity Index (UEI). Then, we divided the mineable asteroids into three classes with different mining difficulties and values, identified 28 mining entities including private companies, national and international organizations. We considered changes in the asteroid classes, mining capabilities and mining scales to determine the changes in the value of minerals mined between 2025 and 2085. We convert mining output value into mineral transaction value through allocation matrix. Based on grey relational analysis (GRA). Finally, we presented three possible versions of the future of asteroid mining by changing the conditions. We propose two sets of corresponding policies for changes in future trends in global fairness with asteroid mining. We test the separate and combined effects of these policies and find that they are positive, strongly supporting the effectiveness of our model.


title: fMRI from EEG is only Deep Learning away: the use of interpretable DL to unravel EEG-fMRI relationships

abstract: The access to activity of subcortical structures offers unique opportunity for building intention dependent brain-computer interfaces, renders abundant options for exploring a broad range of cognitive phenomena in the realm of affective neuroscience including complex decision making processes and the eternal free-will dilemma and facilitates diagnostics of a range of neurological deceases. So far this was possible only using bulky, expensive and immobile fMRI equipment. Here we present an interpretable domain grounded solution to recover the activity of several subcortical regions from the multichannel EEG data and demonstrate up to 60% correlation between the actual subcortical blood oxygenation level dependent sBOLD signal and its EEG-derived twin. Then, using the novel and theoretically justified weight interpretation methodology we recover individual spatial and time-frequency patterns of scalp EEG predictive of the hemodynamic signal in the subcortical nuclei. The described results not only pave the road towards wearable subcortical activity scanners but also showcase an automatic knowledge discovery process facilitated by deep learning technology in combination with an interpretable domain constrained architecture and the appropriate downstream task.


title: The quantum character of the Scalar Field Dark Matter

abstract: The Scalar Field Dark Matter (SFDM) model, also called Fuzzy, Wave, Bose-Einstein, Ultra-light Dark Matter, has received a lot of attention because it has been able to provide simpler and more natural explanations for various features of galaxies, such as the number of satellite galaxies and the cusp-core problem. We recently showed that this model is able to explain the vast polar orbits of satellite galaxies around their host, the so-called VPO, and to explain the X-ray and gamma-ray emissions in the vacuum regions of our galaxy, that is, the Fermi Bubbles. In all these phenomena the quantum character of SFDM has been crucial. In this work we study the quantum effects of SFDM at the cosmological level, to see these effects not only at the galactic scale, but also at the cosmological scale. Using a convenient ansatz, we were able to integrate the perturbed equations to show that the shape of the SFDM halos resembling atoms is a generic result. The main conclusion of this work is that quantum mechanics, the successful microworld theory, could also explain the dark side of the cosmos.