title: Channel Customization for Joint Tx-RISs-Rx Design in Hybrid mmWave Systems

abstract: In strong line-of-sight millimeter-wave (mmWave) wireless systems, the rank-deficient channel severely hampers spatial multiplexing. To address this inherent deficiency, multiple reconfigurable-intelligent-surfaces (RISs) are introduced in this study to customize the wireless channel. Utilizing the RIS to reshape electromagnetic waves, we theoretically show that a favorable channel with an arbitrary tunable rank and a minimized truncated condition number can be established by elaborately designing the placement and reflection matrix of RISs. Different from existing works on multi-RISs, the number of elements needed for each RIS to combat the path loss and the limited phase control is also considered. On the basis of the proposed channel customization, a joint transmitter-RISs-receiver (Tx-RISs-Rx) design under a hybrid mmWave system is investigated to maximize the spectral efficiency. Using the proposed scheme, the optimal singular value decomposition-based hybrid beamforming at the Tx and Rx can be obtained without matrix decomposition for the digital and analog beamforming. The bottoms of the sub-channel mode in the water-filling algorithm, which are conventionally uncontrollable, are proven to be independently adjustable by RISs. Moreover, the transmit power required for realizing multi-stream transmission is derived. Numerical results are presented to verify our theoretical analysis and exhibit substantial gains over systems without RISs.


title: Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations

abstract: In NLP, a large volume of tasks involve pairwise comparison between two sequences (e.g. sentence similarity and paraphrase identification). Predominantly, two formulations are used for sentence-pair tasks: bi-encoders and cross-encoders. Bi-encoders produce fixed-dimensional sentence representations and are computationally efficient, however, they usually underperform cross-encoders. Cross-encoders can leverage their attention heads to exploit inter-sentence interactions for better performance but they require task fine-tuning and are computationally more expensive. In this paper, we present a completely unsupervised sentence representation model termed as Trans-Encoder that combines the two learning paradigms into an iterative joint framework to simultaneously learn enhanced bi- and cross-encoders. Specifically, on top of a pre-trained Language Model (PLM), we start with converting it to an unsupervised bi-encoder, and then alternate between the bi- and cross-encoder task formulations. In each alternation, one task formulation will produce pseudo-labels which are used as learning signals for the other task formulation. We then propose an extension to conduct such self-distillation approach on multiple PLMs in parallel and use the average of their pseudo-labels for mutual-distillation. Trans-Encoder creates, to the best of our knowledge, the first completely unsupervised cross-encoder and also a state-of-the-art unsupervised bi-encoder for sentence similarity. Both the bi-encoder and cross-encoder formulations of Trans-Encoder outperform recently proposed state-of-the-art unsupervised sentence encoders such as Mirror-BERT and SimCSE by up to 5% on the sentence similarity benchmarks.


title: Regularity of the drift for random walks in groups acting on Gromov hyperbolic spaces

abstract: In this work we prove the continuity and existence of large deviations for the drift of random walks on groups acting by isometries on Gromov Hyperbolic Spaces. Through the process we refine the multiplicative ergodic theorem of Karlsson and Gou\"ezel for such spaces. The works goes beyond what is known in the literature by allowing spaces that are not necessarily proper.


title: Searching for Minimal Optimal Neural Networks

abstract: Large neural network models have high predictive power but may suffer from overfitting if the training set is not large enough. Therefore, it is desirable to select an appropriate size for neural networks. The destructive approach, which starts with a large architecture and then reduces the size using a Lasso-type penalty, has been used extensively for this task. Despite its popularity, there is no theoretical guarantee for this technique. Based on the notion of minimal neural networks, we posit a rigorous mathematical framework for studying the asymptotic theory of the destructive technique. We prove that Adaptive group Lasso is consistent and can reconstruct the correct number of hidden nodes of one-hidden-layer feedforward networks with high probability. To the best of our knowledge, this is the first theoretical result establishing for the destructive technique.


title: Forecasting of COVID-19 Cases, Using an Evolutionary Neural Architecture Search Approach

abstract: In late 2019, COVID-19, a severe respiratory disease, emerged, and since then, the world has been facing a deadly pandemic caused by it. This ongoing pandemic has had a significant effect on different aspects of societies. The uncertainty around the number of daily cases made it difficult for decision-makers to control the outbreak. Deep Learning models have proved that they can come in handy in many real-world problems such as healthcare ones. However, they require a lot of data to learn the features properly and output an acceptable solution. Since COVID-19 has been a lately emerged disease, there was not much data available, especially in the first stage of the pandemic, and this shortage of data makes it challenging to design an optimized model. To overcome these problems, we first introduce a new dataset with augmented features and then forecast COVID-19 cases with a new approach, using an evolutionary neural architecture search with Binary Bat Algorithm (BBA) to generate an optimized deep recurrent network. Finally, to show our approach's effectiveness, we conducted a comparative study on Iran's COVID-19 daily cases. The results prove our approach's capability to generate an accurate deep architecture to forecast the pandemic cases, even in the early stages with limited data.


title: An Automated Multi-Web Platform Voting Framework to Predict Misleading Information Proliferated during COVID-19 Outbreak using Ensemble Method

abstract: Spreading of misleading information on social web platforms has fuelled huge panic and confusion among the public regarding the Corona disease, the detection of which is of paramount importance. To address this issue, in this paper, we have developed an automated system that can collect and validate the fact from multi web-platform to decide the credibility of the content. To identify the credibility of the posted claim, probable instances/clues(titles) of news information are first gathered from various web platforms. Later, the crucial set of features is retrieved that further feeds into the ensemble-based machine learning model to classify the news as misleading or real. The four sets of features based on the content, linguistics/semantic cues, similarity, and sentiments gathered from web-platforms and voting are applied to validate the news. Finally, the combined voting decides the support given to a specific claim. In addition to the validation part, a unique source platform is designed for collecting data/facts from three web platforms (Twitter, Facebook, Google) based on certain queries/words. This unique platform can also help researchers build datasets and gather useful/efficient clues from various web platforms. It has been observed that our proposed intelligent strategy gives promising results and quite effective in predicting misleading information. The proposed work provides practical implications for the policy makers and health practitioners that could be useful in protecting the world from misleading information proliferation during this pandemic.


title: Modeling repeated self-reported outcome data: a continuous-time longitudinal Item Response Theory model

abstract: Item Response Theory (IRT) models have received growing interest in health science for analyzing latent constructs such as depression, anxiety, quality of life, or cognitive functioning from the information provided by each individual's items responses. However, in the presence of repeated item measures, IRT methods usually assume that the measurement occasions are made at the exact same time for all patients. In this paper, we show how the IRT methodology can be combined with the mixed model theory to provide a longitudinal IRT model which exploits the information of a measurement scale provided at the item level while simultaneously handling observation times that may vary across individuals and items. The latent construct is a latent process defined in continuous time that is linked to the observed item responses through a measurement model at each individual- and occasion-specific observation time; we focus here on a Graded Response Model for binary and ordinal items. The Maximum Likelihood Estimation procedure of the model is available in the R package lcmm. The proposed approach is contextualized in a clinical example in end-stage renal disease, the PREDIALA study. The objective is to study the trajectories of depressive symptomatology (as measured by 7 items of the Hospital Anxiety and Depression scale) according to the time from registration on the renal transplant waiting list and the renal replacement therapy. We also illustrate how the method can be used to assess Differential Item Functioning and lack of measurement invariance over time.


title: Towards "Zero-buffer" Datacenter Networks

abstract: In this paper, we investigate the possibility of building a data center network (DCN) with simplified zero-buffer switches. It exposes a stringent requirement to the traffic control scheme to ensure perfect collision-free between packets. We find it is infeasible, if not impossible, to make a large-scale DCN completely zero buffering. We take a step back and propose Fastpod, a new data center architecture that enables zero buffering in pod scale, which can be expanded with buffered devices. With time synchronization, Fastpod avoids collisions by performing fine-grained centralized control on data packets and coordination-free scheduling on control packets. It leverages an optimistic sending mechanism to reduce the latency overhead induced by the centralized control. Our preliminary simulation results indicate that Fastpod successfully meets the requirement of collision-free in the zero-buffer pod and maintains similar performance with conventional buffered DCN. It follows the trend of simplifying the network by pushing the functionalities to the edge. Fastpod explores an extreme end of the design spectrum and can be treated as a thought experiment to raise discussion in the community of data center networks.


title: Prefix-to-SQL: Text-to-SQL Generation from Incomplete User Questions

abstract: Existing text-to-SQL research only considers complete questions as the input, but lay-users might strive to formulate a complete question. To build a smarter natural language interface to database systems (NLIDB) that also processes incomplete questions, we propose a new task, prefix-to-SQL which takes question prefix from users as the input and predicts the intended SQL. We construct a new benchmark called PAGSAS that contains 124K user question prefixes and the intended SQL for 5 sub-tasks Advising, GeoQuery, Scholar, ATIS, and Spider. Additionally, we propose a new metric SAVE to measure how much effort can be saved by users. Experimental results show that PAGSAS is challenging even for strong baseline models such as T5. As we observe the difficulty of prefix-to-SQL is related to the number of omitted tokens, we incorporate curriculum learning of feeding examples with an increasing number of omitted tokens. This improves scores on various sub-tasks by as much as 9% recall scores on sub-task GeoQuery in PAGSAS.


title: Multi-Task and Multi-Corpora Training Strategies to Enhance Argumentative Sentence Linking Performance

abstract: Argumentative structure prediction aims to establish links between textual units and label the relationship between them, forming a structured representation for a given input text. The former task, linking, has been identified by earlier works as particularly challenging, as it requires finding the most appropriate structure out of a very large search space of possible link combinations. In this paper, we improve a state-of-the-art linking model by using multi-task and multi-corpora training strategies. Our auxiliary tasks help the model to learn the role of each sentence in the argumentative structure. Combining multi-corpora training with a selective sampling strategy increases the training data size while ensuring that the model still learns the desired target distribution well. Experiments on essays written by English-as-a-foreign-language learners show that both strategies significantly improve the model's performance; for instance, we observe a 15.8% increase in the F1-macro for individual link predictions.


title: Synthesis and Characterizations of CH3NH3PbI3:ZnS Microrods for Optoelectronic Applications

abstract: Organometallic perovskite is one of the potential materials in the various optoelectronic research fields. This research work demonstrates the synthesis of CH3NH3PbI3-ZnS microrods via one-step spin coating for optoelectronic applications. Incorporation of ZnS in the perovskite material caused bandgap variation in the visible wavelength range.


title: Cluster Attack: Query-based Adversarial Attacks on Graphs with Graph-Dependent Priors

abstract: While deep neural networks have achieved great success in graph analysis, recent work has shown that they are vulnerable to adversarial attacks. Compared with adversarial attacks on image classification, performing adversarial attacks on graphs is more challenging because of the discrete and non-differential nature of the adjacent matrix for a graph. In this work, we propose Cluster Attack -- a Graph Injection Attack (GIA) on node classification, which injects fake nodes into the original graph to degenerate the performance of graph neural networks (GNNs) on certain victim nodes while affecting the other nodes as little as possible. We demonstrate that a GIA problem can be equivalently formulated as a graph clustering problem; thus, the discrete optimization problem of the adjacency matrix can be solved in the context of graph clustering. In particular, we propose to measure the similarity between victim nodes by a metric of Adversarial Vulnerability, which is related to how the victim nodes will be affected by the injected fake node, and to cluster the victim nodes accordingly. Our attack is performed in a practical and unnoticeable query-based black-box manner with only a few nodes on the graphs that can be accessed. Theoretical analysis and extensive experiments demonstrate the effectiveness of our method by fooling the node classifiers with only a small number of queries.


title: Controllable Neural Dialogue Summarization with Personal Named Entity Planning

abstract: In this paper, we propose a controllable neural generation framework that can flexibly guide dialogue summarization with personal named entity planning. The conditional sequences are modulated to decide what types of information or what perspective to focus on when forming summaries to tackle the under-constrained problem in summarization tasks. This framework supports two types of use cases: (1) Comprehensive Perspective, which is a general-purpose case with no user-preference specified, considering summary points from all conversational interlocutors and all mentioned persons; (2) Focus Perspective, positioning the summary based on a user-specified personal named entity, which could be one of the interlocutors or one of the persons mentioned in the conversation. During training, we exploit occurrence planning of personal named entities and coreference information to improve temporal coherence and to minimize hallucination in neural generation. Experimental results show that our proposed framework generates fluent and factually consistent summaries under various planning controls using both objective metrics and human evaluations.


title: Laser-induced thermal source for cold atoms

abstract: We demonstrate a simple and compact approach to laser cool and trap atoms based on laser-induced thermal ablation (LITA) of a pure solid granule. A rapid thermalisation of the granule leads to a fast recovery of the ultra-high vacuum condition required for a long trapping lifetime of the cold gas. We give a proof-of-concept of the technique, performing a magneto-optical trap on the 461 nm $^1S_0\rightarrow^1P_1$ transition of strontium. We get up to 3.5 million of cold strontium-88 atoms with a trapping lifetime of more than 4 s. The lifetime is limited by the pressure of the strontium-free residual background vapour. We also implement an original configuration of permanent magnets to create the quadruple magnetic field of the magneto-optical trap. The LITA technique can be generalized to other atomic elements such as transition metals and lanthanide atoms, and shows a strong potential for applications in quantum technologies ranging from quantum computing to precision measurements such as outdoor inertial sensing.


title: Estimating Angle of Arrival (AoA) of multiple Echoes in a Steering Vector Space

abstract: Consider a microphone array, such as those present in Amazon Echos, conference phones, or self-driving cars. One of the goals of these arrays is to decode the angles in which acoustic signals arrive at them. This paper considers the problem of estimating K angle of arrivals (AoA), i.e., the direct path's AoA and the AoA of subsequent echoes. Significant progress has been made on this problem, however, solutions remain elusive when the source signal is unknown (such as human voice) and the channel is strongly correlated (such as in multipath settings). Today's algorithms reliably estimate the direct-path-AoA, but the subsequent AoAs diverge in noisy real-world conditions. We design SubAoA, an algorithm that improves on the current body of work. Our core idea models signal in a new AoA sub-space, and employs a cancellation approach that successively cancels each AoA to decode the next. We explain the behavior and complexity of the algorithm from the first principles, simulate the performance across a range of parameters, and present results from real-world experiments. Comparison against multiple existing algorithms like GCC-PHAT, MUSIC, and VoLoc shows increasing gains for the latter AoAs, while our computation complexity allows real-time operation. We believe progress in multi-AoA estimation is a fundamental building block to various acoustic and RF applications, including human or vehicle localization, multi-user separation, and even (blind) channel estimation.


title: Improving Stack Overflow question title generation with copying enhanced CodeBERT model and bi-modal information

abstract: Context: Stack Overflow is very helpful for software developers who are seeking answers to programming problems. Previous studies have shown that a growing number of questions are of low quality and thus obtain less attention from potential answerers. Gao et al. proposed an LSTM-based model (i.e., BiLSTM-CC) to automatically generate question titles from the code snippets to improve the question quality. However, only using the code snippets in the question body cannot provide sufficient information for title generation, and LSTMs cannot capture the long-range dependencies between tokens. Objective: This paper proposes CCBERT, a deep learning based novel model to enhance the performance of question title generation by making full use of the bi-modal information of the entire question body. Method: CCBERT follows the encoder-decoder paradigm and uses CodeBERT to encode the question body into hidden representations, a stacked Transformer decoder to generate predicted tokens, and an additional copy attention layer to refine the output distribution. Both the encoder and decoder perform the multi-head self-attention operation to better capture the long-range dependencies. This paper builds a dataset containing around 200,000 high-quality questions filtered from the data officially published by Stack Overflow to verify the effectiveness of the CCBERT model. Results: CCBERT outperforms all the baseline models on the dataset. Experiments on both code-only and low-resource datasets show the superiority of CCBERT with less performance degradation. The human evaluation also shows the excellent performance of CCBERT concerning both readability and correlation criteria.


title: Self-Consistent Determination of Long-Range Electrostatics in Neural Network Potentials

abstract: Machine learning has the potential to revolutionize the field of molecular simulation through the development of efficient and accurate models of interatomic interactions. In particular, neural network models can describe interactions at the level of accuracy of quantum mechanics-based calculations, but with a fraction of the cost, enabling the simulation of large systems over long timescales with ab initio accuracy. However, implicit in the construction of neural network potentials is an assumption of locality, wherein atomic arrangements on the scale of about a nanometer are used to learn interatomic interactions. Because of this assumption, the resulting neural network models cannot describe long-range interactions that play critical roles in dielectric screening and chemical reactivity. To address this issue, we introduce the self-consistent field neural network (SCFNN) model -- a general approach for learning the long-range response of molecular systems in neural network potentials. The SCFNN model relies on a physically meaningful separation of the interatomic interactions into short- and long-range components, with a separate network to handle each component. We demonstrate the success of the SCFNN approach in modeling the dielectric properties of bulk liquid water, and show that the SCFNN model accurately predicts long-range polarization correlations and the response of water to applied electrostatic fields. Importantly, because of the separation of interactions inherent in our approach, the SCFNN model can be combined with many existing approaches for building neural network potentials. Therefore, we expect the SCFNN model to facilitate the proper description of long-range interactions in a wide-variety of machine learning-based force fields.


title: An Integrated Quantum Material Testbed with Multi-Resolution Photoemission Spectroscopy

abstract: We present the development of a multi-resolution photoemission spectroscopy (MRPES) setup which probes quantum materials in energy, momentum, space, and time. This versatile setup integrates three light sources in one photoemission setup, and can conveniently switch between traditional angle-resolved photoemission spectroscopy (ARPES), time-resolved ARPES (trARPES), and micron-scale spatially resolved ARPES ($\mu$ARPES). It provides a first-time all-in-one solution to achieve an energy resolution $< 4$ meV, a time resolution $< 35$ fs, and a spatial resolution $\sim 10$ $\mu$m in photoemission spectroscopy. Remarkably, we obtain the shortest time resolution among the trARPES setups using solid-state nonlinear crystals for frequency upconversion. Furthermore, this MRPES setup is integrated with a shadow-mask assisted molecular beam epitaxy system, which transforms the traditional photoemission spectroscopy into a quantum device characterization instrument. We demonstrate the functionalities of this novel quantum material testbed using FeSe/SrTiO$_3$ thin films and MnBi$_4$Te$_7$ magnetic topological insulators.


title: Using neural networks to solve the 2D Poisson equation for electric field computation in plasma fluid simulations

abstract: The Poisson equation is critical to get a self-consistent solution in plasma fluid simulations used for Hall effect thrusters and streamer discharges, since the Poisson solution appears as a source term of the unsteady nonlinear flow equations. As a first step, solving the 2D Poisson equation with zero Dirichlet boundary conditions using a deep neural network is investigated using multiple-scale architectures, defined in terms of number of branches, depth and receptive field. One key objective is to better understand how neural networks learn the Poisson solutions and provide guidelines to achieve optimal network configurations, especially when coupled to the time-varying Euler equations with plasma source terms. Here, the Receptive Field is found critical to correctly capture large topological structures of the field. The investigation of multiple architectures, losses, and hyperparameters provides an optimal network to solve accurately the steady Poisson problem. The performance of the optimal neural network solver, called PlasmaNet, is then monitored on meshes with increasing number of nodes, and compared with classical parallel linear solvers. Next, PlasmaNet is coupled with an unsteady Euler plasma fluid equations solver in the context of the electron plasma oscillation test case. In this time-evolving problem, a physical loss is necessary to produce a stable simulation. PlasmaNet is finally tested on a more complex case of discharge propagation involving chemistry and advection. The guidelines established in previous sections are applied to build the CNN to solve the same Poisson equation in cylindrical coordinates with different boundary conditions. Results reveal good CNN predictions and pave the way to new computational strategies using modern GPU-based hardware to predict unsteady problems involving a Poisson equation.


title: A human factors approach to validating driver models for interaction-aware automated vehicles

abstract: A major challenge for autonomous vehicles is interacting with other traffic participants safely and smoothly. A promising approach to handle such traffic interactions is equipping autonomous vehicles with interaction-aware controllers (IACs). These controllers predict how surrounding human drivers will respond to the autonomous vehicle's actions, based on a driver model. However, the predictive validity of driver models used in IACs is rarely validated, which can limit the interactive capabilities of IACs outside the simple simulated environments in which they are demonstrated. In this paper, we argue that besides evaluating the interactive capabilities of IACs, their underlying driver models should be validated on natural human driving behavior. We propose a workflow for this validation that includes scenario-based data extraction and a two-stage (tactical/operational) evaluation procedure based on human factors literature. We demonstrate this workflow in a case study on an inverse-reinforcement-learning-based driver model replicated from an existing IAC. This model only showed the correct tactical behavior in 40% of the predictions. The model's operational behavior was inconsistent with observed human behavior. The case study illustrates that a principled evaluation workflow is useful and needed. We believe that our workflow will support the development of appropriate driver models for future automated vehicles.


title: Analysis of chaotic dynamical systems with autoencoders

abstract: We focus on chaotic dynamical systems and analyze their time series with the use of autoencoders, i.e., configurations of neural networks that map identical output to input. This analysis results in the determination of the latent space dimension of each system and thus determines the minimal number of nodes necessary to capture the essential information contained in the chaotic time series. The constructed chaotic autoencoders generate similar maximal Lyapunov exponents as the original chaotic systems and thus encompass their essential dynamical information.


title: On the power of choice for Boolean functions

abstract: In this paper we consider a variant of the well-known Achlioptas process for graphs adapted to monotone Boolean functions. Fix a number of choices $r\in \mathbb N$ and a sequence of increasing functions $(f_n)_{n\ge 1}$ such that, for every $n\ge 1$, $f_n:\{0,1\}^n\mapsto \{0,1\}$. Given $n$ bits which are all initially equal to 0, at each step $r$ 0-bits are sampled uniformly at random and are proposed to an agent. Then, the agent selects one of the proposed bits and turns it from 0 to 1 with the goal to reach the preimage of 1 as quickly as possible. We nearly characterize the conditions under which an acceleration by a factor of $r(1+o(1))$ is possible, and underline the wide applicability of our results by giving examples from the fields of Boolean functions and graph theory.


title: Measures of quasisymmetry for stellarators

abstract: Quasisymmetric stellarators are an attractive class of optimised magnetic confinement configurations. The property of quasisymmetry (QS) is in practice limited to be approximate, and thus the construction requires measures that quantify the deviation from the exact property. In this paper we study three measure candidates used in the literature, placing the focus on their origin and the comparison of their forms. The analysis shows clearly the lack of universality in these measures. As these metrics do not directly correspond to any physical property (except when exactly QS), optimisation should employ additional physical metrics for guidance. Especially close to QS minima, treating QS metrics through inequality constraints so that additional physics metrics dominate optimisation is suggested. The impact of different quasisymmetric measures on optimisation is presented through an example.


title: Semi-Autonomous Teleoperation via Learning Non-Prehensile Manipulation Skills

abstract: In this paper, we present a semi-autonomous teleoperation framework for a pick-and-place task using an RGB-D sensor. In particular, we assume that the target object is located in a cluttered environment where both prehensile grasping and non-prehensile manipulation are combined for efficient teleoperation. A trajectory-based reinforcement learning is utilized for learning the non-prehensile manipulation to rearrange the objects for enabling direct grasping. From the depth image of the cluttered environment and the location of the goal object, the learned policy can provide multiple options of non-prehensile manipulation to the human operator. We carefully design a reward function for the rearranging task where the policy is trained in a simulational environment. Then, the trained policy is transferred to a real-world and evaluated in a number of real-world experiments with the varying number of objects where we show that the proposed method outperforms manual keyboard control in terms of the time duration for the grasping.


title: Displacement memory and BMS symmetries

abstract: This article reviews one of the most intriguing properties of black hole spacetimes known in the literature -- gravitational memory effect, and its connection with asymptotic symmetries, also termed as Bondi-van der Burg-Metzner-Sachs (BMS) symmetries, emerging near the horizon of black holes. Gravitational memory is a non-oscillatory part of the gravitational wave amplitude which generates a permanent displacement for freely falling test particles or test detectors. We highlight a model scenario where asymptotic symmetries appear as a soldering freedom in the context of stitching of two black hole spacetimes, and examine the impact of the interaction between test detectors and horizon shells. Further, we provide a more realistic approach of computing displacement memory for near-horizon asymptotic symmetries which is analogous to the conventional memory originally obtained at asymptotic null infinity.


title: On the laws of the iterated logarithm under the sub-linear expectations without the assumption on the continuity of capacities

abstract: In this paper, we establish some general forms of the law of the iterated logarithm for independent random variables in a sub-linear expectation space, where the random variables are not necessarily identically distributed. Exponential inequalities for the maximum sum of independent random variables and Kolmogorov's converse exponential inequalities are established as tools for showing the law of the iterated logarithm. As an application, the sufficient and necessary conditions of the law of iterated logarithm for independent and identically distributed random variables under the sub-linear expectation are obtained. In the paper, it is also shown that if the sub-linear expectation space is rich and regular enough, it will have no continuous capacity. The laws of the iterated logarithm are established without the assumption on the continuity of capacities. This revision fills a gap in the proof of Proposition 4.2 of arXiv:2103.01390 under an additional assumption.


title: Surface Reduction State Determines Stabilization and Incorporation of Rh on {\alpha}-Fe2O3(1-102)

abstract: Iron oxides (FeOx) are among the most common support materials utilized in single atom catalysis. The support is nominally Fe2O3, but strongly reductive treatments are usually applied to activate the as-synthesized catalyst prior to use. Here, we study Rh adsorption and incorporation on the (1-102) surface of hematite ({\alpha}-Fe2O3), which switches from a stoichiometric (1x1) termination to a reduced (2x1) reconstruction in reducing conditions. Rh atoms form clusters at room temperature on both surface terminations, but Rh atoms incorporate into the support lattice as isolated atoms upon annealing above 400 {\deg}C. Under mildly oxidizing conditions, the incorporation process is so strongly favoured that even large Rh clusters containing hundreds of atoms dissolve into the surface. Based on a combination of low energy ion scattering and scanning tunnelling microscopy data, as well as density functional theory, we conclude that the Rh atoms are stabilized in the immediate subsurface, rather than the surface layer.


title: Towards the Classification of Error-Related Potentials using Riemannian Geometry

abstract: The error-related potential (ErrP) is an event-related potential (ERP) evoked by an experimental participant's recognition of an error during task performance. ErrPs, originally described by cognitive psychologists, have been adopted for use in brain-computer interfaces (BCIs) for the detection and correction of errors, and the online refinement of decoding algorithms. Riemannian geometry-based feature extraction and classification is a new approach to BCI which shows good performance in a range of experimental paradigms, but has yet to be applied to the classification of ErrPs. Here, we describe an experiment that elicited ErrPs in seven normal participants performing a visual discrimination task. Audio feedback was provided on each trial. We used multi-channel electroencephalogram (EEG) recordings to classify ErrPs (success/failure), comparing a Riemannian geometry-based method to a traditional approach that computes time-point features. Overall, the Riemannian approach outperformed the traditional approach (78.2% versus 75.9% accuracy, p < 0.05); this difference was statistically significant (p < 0.05) in three of seven participants. These results indicate that the Riemannian approach better captured the features from feedback-elicited ErrPs, and may have application in BCI for error detection and correction.


title: MFEViT: A Robust Lightweight Transformer-based Network for Multimodal 2D+3D Facial Expression Recognition

abstract: Vision transformer (ViT) has been widely applied in many areas due to its self-attention mechanism that help obtain the global receptive field since the first layer. It even achieves surprising performance exceeding CNN in some vision tasks. However, there exists an issue when leveraging vision transformer into 2D+3D facial expression recognition (FER), i.e., ViT training needs mass data. Nonetheless, the number of samples in public 2D+3D FER datasets is far from sufficient for evaluation. How to utilize the ViT pre-trained on RGB images to handle 2D+3D data becomes a challenge. To solve this problem, we propose a robust lightweight pure transformer-based network for multimodal 2D+3D FER, namely MFEViT. For narrowing the gap between RGB and multimodal data, we devise an alternative fusion strategy, which replaces each of the three channels of an RGB image with the depth-map channel and fuses them before feeding them into the transformer encoder. Moreover, the designed sample filtering module adds several subclasses for each expression and move the noisy samples to their corresponding subclasses, thus eliminating their disturbance on the network during the training stage. Extensive experiments demonstrate that our MFEViT outperforms state-of-the-art approaches with an accuracy of 90.83% on BU-3DFE and 90.28% on Bosphorus. Specifically, the proposed MFEViT is a lightweight model, requiring much fewer parameters than multi-branch CNNs. To the best of our knowledge, this is the first work to introduce vision transformer into multimodal 2D+3D FER. The source code of our MFEViT will be publicly available online.


title: Contextual Fine-to-Coarse Distillation for Coarse-grained Response Selection in Open-Domain Conversations

abstract: We study the problem of coarse-grained response selection in retrieval-based dialogue systems. The problem is equally important with fine-grained response selection, but is less explored in existing literature. In this paper, we propose a Contextual Fine-to-Coarse (CFC) distilled model for coarse-grained response selection in open-domain conversations. In our CFC model, dense representations of query, candidate response and corresponding context is learned based on the multi-tower architecture, and more expressive knowledge learned from the one-tower architecture (fine-grained) is distilled into the multi-tower architecture (coarse-grained) to enhance the performance of the retriever. To evaluate the performance of our proposed model, we construct two new datasets based on the Reddit comments dump and Twitter corpus. Extensive experimental results on the two datasets show that the proposed methods achieve a significant improvement over all evaluation metrics compared with traditional baseline methods.


title: Absence of Normal Fluctuations in an Integrable Magnet

abstract: We investigate dynamical fluctuations of transferred magnetization in the one-dimensional lattice Landau--Lifshitz magnet with uniaxial anisotropy, representing an emblematic model of interacting spins. We demonstrate that the structure of fluctuations in thermal equilibrium depends radically on the characteristic dynamical scale. In the ballistic regime, typical fluctuations are found to follow a normal distribution and scaled cumulants are finite. In stark contrast, on the diffusive and superdiffusive timescales, relevant respectively for the easy-axis and isotropic magnet at vanishing total magnetization, typical fluctuations are no longer Gaussian and, remarkably, scaled cumulants are divergent. The observed anomalous features disappear upon breaking integrability, suggesting that the absence of normal fluctuations is intimately tied to the presence of soliton modes. In a nonequilibrium setting of the isotropic magnet with weakly polarized step-profile initial state we find a slow drift of dynamical exponent from the superdiffusive towards the diffusive value.


title: Automated Mining of Leaderboards for Empirical AI Research

abstract: With the rapid growth of research publications, empowering scientists to keep oversight over the scientific progress is of paramount importance. In this regard, the Leaderboards facet of information organization provides an overview on the state-of-the-art by aggregating empirical results from various studies addressing the same research challenge. Crowdsourcing efforts like PapersWithCode among others are devoted to the construction of Leaderboards predominantly for various subdomains in Artificial Intelligence. Leaderboards provide machine-readable scholarly knowledge that has proven to be directly useful for scientists to keep track of research progress. The construction of Leaderboards could be greatly expedited with automated text mining. This study presents a comprehensive approach for generating Leaderboards for knowledge-graph-based scholarly information organization. Specifically, we investigate the problem of automated Leaderboard construction using state-of-the-art transformer models, viz. Bert, SciBert, and XLNet. Our analysis reveals an optimal approach that significantly outperforms existing baselines for the task with evaluation scores above 90% in F1. This, in turn, offers new state-of-the-art results for Leaderboard extraction. As a result, a vast share of empirical AI research can be organized in the next-generation digital libraries as knowledge graphs.


title: Oscillatory Fourier Neural Network: A Compact and Efficient Architecture for Sequential Processing

abstract: Tremendous progress has been made in sequential processing with the recent advances in recurrent neural networks. However, recurrent architectures face the challenge of exploding/vanishing gradients during training, and require significant computational resources to execute back-propagation through time. Moreover, large models are typically needed for executing complex sequential tasks. To address these challenges, we propose a novel neuron model that has cosine activation with a time varying component for sequential processing. The proposed neuron provides an efficient building block for projecting sequential inputs into spectral domain, which helps to retain long-term dependencies with minimal extra model parameters and computation. A new type of recurrent network architecture, named Oscillatory Fourier Neural Network, based on the proposed neuron is presented and applied to various types of sequential tasks. We demonstrate that recurrent neural network with the proposed neuron model is mathematically equivalent to a simplified form of discrete Fourier transform applied onto periodical activation. In particular, the computationally intensive back-propagation through time in training is eliminated, leading to faster training while achieving the state of the art inference accuracy in a diverse group of sequential tasks. For instance, applying the proposed model to sentiment analysis on IMDB review dataset reaches 89.4% test accuracy within 5 epochs, accompanied by over 35x reduction in the model size compared to LSTM. The proposed novel RNN architecture is well poised for intelligent sequential processing in resource constrained hardware.


title: Early stages of aggregation in fluid mixtures of dimers and spheres: a theoretical and simulation study

abstract: We use Monte Carlo simulation and the Reference Interaction Site Model (RISM) theory of molecular fluids to investigate a simple model of colloidal mixture consisting of dimers, made up of two tangent hard monomers of different size, and hard spheres. In addition to steric repulsion, the two species interact via a square-well attraction only between small monomers and spheres. Recently, we have characterized the low-temperature regime of this mixture by Monte Carlo, reporting on the spontaneous formation of a wide spectrum of supramolecular aggregates [Prestipino et al, J. Phys. Chem. B, 2019, 123, 9272]. Here we focus on a regime of temperatures where, on cooling, the appearance of local inhomogeneties first, and the early stages of aggregation thereafter, are observed. In particular, we find signatures of aggregation in the onset of a low-wavevector peak in the structure factors of the mixture, as computed by both theory and simulation. Then, we link the structural information to the microscopic arrangement through a detailed cluster analysis of Monte Carlo configurations. In this regard, we devise a novel method to compute the maximum distance for which two spheres can be regarded as bonded together, a crucial issue in the proper identification of fluid aggregates. The RISM theory provides relatively accurate structural and thermodynamic predictions in comparison with Monte Carlo, but with slightly degrading performances as the fluid progresses inside the locally inhomogeneous phase. Our study certifies the efficacy of the RISM approach as a useful complement to numerical simulation for a reasoned analysis of aggregation properties in colloidal mixtures.


title: Resultants of skew polynomials over division rings

abstract: Let $\mathbb{F}$ be a division ring. In this paper, we extent some of the main well-known results about the resultant of two univariate polynomials to the more general context of an Ore extension $\mathbb{F}[x;\sigma,\delta]$. Finally, some algorithms and Magma programs are given as a numerical application of the main theoretical results of this paper.


title: Convolution bialgebra of a Lie groupoid and transversal distributions

abstract: For a Lie groupoid G over a smooth manifold M we construct the adjoint action of the etale Lie groupoid G# of germs of local bisections of G on the Lie algebroid g of G. With this action, we form the associated convolution C_c(M)/R-bialgebra C_c(G#,g). We represent this C_c(M)/R-bialgebra in the algebra of transversal distributions on G. This construction extends the Cartier-Gabriel decomposition of the Hopf algebra of distributions with finite support on a Lie group.


title: Inferring Facing Direction from Voice Signals

abstract: Consider a home or office where multiple devices are running voice assistants (e.g., TVs, lights, ovens, refrigerators, etc.). A human user turns to a particular device and gives a voice command, such as ``Alexa, can you ...''. This paper focuses on the problem of detecting which device the user was facing, and therefore, enabling only that device to respond to the command. Our core intuition emerges from the fact that human voice exhibits a directional radiation pattern, and the orientation of this pattern should influence the signal received at each device. Unfortunately, indoor multipath, unknown user location, and unknown voice signals pose as critical hurdles. Through a new algorithm that estimates the line-of-sight (LoS) power from a given signal, and combined with beamforming and triangulation, we design a functional solution called CoDIR. Results from $500+$ configurations, across $5$ rooms and $9$ different users, are encouraging. While improvements are necessary, we believe this is an important step forward in a challenging but urgent problem space.


title: Short proof of the asymptotic confirmation of the Faudree-Lehel Conjecture

abstract: Given a simple graph $G$, the {\it irregularity strength} of $G$, denoted $s(G)$, is the least positive integer $k$ such that there is a weight assignment on edges $f: E(G) \to \{1,2,\dots, k\}$ for which each vertex weight $f^V(v):= \sum_{u: \{u,v\}\in E(G)} f(\{u,v\})$ is unique amongst all $v\in V(G)$. In 1987, Faudree and Lehel conjectured that there is a constant $c$ such that $s(G) \leq n/d + c$ for all $d$-regular graphs $G$ on $n$ vertices with $d>1$, whereas it is trivial that $s(G) \geq n/d$. In this short note we prove that the Faudree-Lehel Conjecture holds when $d \geq n^{0.8+\epsilon}$ for any fixed $\epsilon >0$, with a small additive constant $c=28$ for $d$ large enough. Furthermore, we confirm the conjecture asymptotically by proving that for any fixed $\beta\in(0,1/4)$ there is a constant $C$ such that for all $d$-regular graphs $G$, $s(G) \leq \frac{n}{d}(1+\frac{C}{d^{\beta}})+28$, extending and improving a recent result of Przyby{\l}o that $s(G) \leq \frac{n}{d}(1+ \frac{1}{\ln^{\epsilon/19}n})$ whenever $d\in [\ln^{1+\epsilon} n, n/\ln^{\epsilon}n]$ and $d$ is large enough.


title: Learning Transport Processes with Machine Intelligence

abstract: We present a machine learning based approach to address the study of transport processes, ubiquitous in continuous mechanics, with particular attention to those phenomena ruled by complex micro-physics, impractical to theoretical investigation, yet exhibiting emergent behavior describable by a closed mathematical expression. Our machine learning model, built using simple components and following a few well established practices, is capable of learning latent representations of the transport process substantially closer to the ground truth than expected from the nominal error characterising the data, leading to sound generalisation properties. This is demonstrated through an idealized study of the long standing problem of heat flux suppression relevant to fusion and cosmic plasmas. Our analysis shows that the result applies beyond those case specific assumptions and that, in particular, the accuracy of the learned representation is controllable through knowledge of the data quality (error properties) and a suitable choice of the dataset size. While the learned representation can be used as a plug-in for numerical modeling purposes, it can also be leveraged with the above error analysis to obtain reliable mathematical expressions describing the transport mechanism and of great theoretical value.


title: Towards Reinforcement Learning for Pivot-based Neural Machine Translation with Non-autoregressive Transformer

abstract: Pivot-based neural machine translation (NMT) is commonly used in low-resource setups, especially for translation between non-English language pairs. It benefits from using high resource source-pivot and pivot-target language pairs and an individual system is trained for both sub-tasks. However, these models have no connection during training, and the source-pivot model is not optimized to produce the best translation for the source-target task. In this work, we propose to train a pivot-based NMT system with the reinforcement learning (RL) approach, which has been investigated for various text generation tasks, including machine translation (MT). We utilize a non-autoregressive transformer and present an end-to-end pivot-based integrated model, enabling training on source-target data.


title: One-Hot Graph Encoder Embedding

abstract: In this paper we propose a lightning fast graph embedding method called one-hot graph encoder embedding. It has a linear computational complexity and the capacity to process billions of edges within minutes on standard PC -- making it an ideal candidate for huge graph processing. It is applicable to either adjacency matrix or graph Laplacian, and can be viewed as a transformation of the spectral embedding. Under random graph models, the graph encoder embedding is approximately normally distributed per vertex, and asymptotically converges to its mean. We showcase three applications: vertex classification, vertex clustering, and graph bootstrap. In every case, the graph encoder embedding exhibits unrivalled computational advantages.


title: Clone-based code method usage pattern mining

abstract: When programmers retrieve a code method and want to reuse it, they need to understand the usage patterns of the retrieved method. However, it is difficult to obtain usage information of the retrieved method since this method may only have a brief comment and few available usage examples. In this paper, we propose an approach, called LUPIN (cLone-based Usage Pattern mIniNg), to mine the usage patterns of these methods, which do not widely appeared in the code repository. The key idea of LUPIN is that the cloned code of the target method may have a similar usage pattern, and we can collect more usage information of the target method from cloned code usage examples. From the amplified usage examples, we mine the usage pattern of the target method by frequent subsequence mining after program slicing and code normalization. Our evaluation shows that LUPIN can mine four categories of usage patterns with an average precision of 0.65.


title: Casting exploit analysis as a Weird Machine reconstruction problem

abstract: Exploits constitute malware in the form of application inputs. They take advantage of security vulnerabilities inside programs in order to yield execution control to attackers. The root cause of successful exploitation lies in emergent functionality introduced when programs are compiled and loaded in memory for execution, called `Weird Machines' (WMs). Essentially WMs are unexpected virtual machines that execute attackers' bytecode, complicating malware analysis whenever the bytecode set is unknown. We take the direction that WM bytecode is best understood at the level of the process memory layout attained by exploit execution. Each step building towards this memory layout comprises an exploit primitive, an exploit's basic building block. This work presents a WM reconstruction algorithm that works by identifying pre-defined exploit primitive-related behaviour during the dynamic analysis of target binaries, associating it with the responsible exploit segment - the WM bytecode. In this manner any analyst familiar with exploit programming will immediately recognise the reconstructed WM bytecode's semantics. This work is a first attempt at studying the feasibility of this method and focuses on web browsers when targeted by JavaScript exploits.


title: Half a Dozen Real-World Applications of Evolutionary Multitasking, and More

abstract: Until recently, the potential to transfer evolved skills across distinct optimization problem instances (or tasks) was seldom explored in evolutionary computation. The concept of evolutionary multitasking (EMT) fills this gap. It unlocks a population's implicit parallelism to jointly solve a set of tasks, hence creating avenues for skills transfer between them. Despite it being early days, the idea of EMT has begun to show promise in a range of real-world applications. In the backdrop of recent advances, the contribution of this paper is twofold. First, a review of several application-oriented explorations of EMT in the literature is presented; the works are assimilated into half a dozen broad categories according to their respective application domains. Each of these six categories elaborates fundamental motivations to multitask, and contains a representative experimental study (referred from the literature). Second, a set of recipes is provided showing how problem formulations of general interest, those that cut across different disciplines, could be transformed in the new light of EMT. Our discussions emphasize the many practical use-cases of EMT, and is intended to spark future research towards crafting novel algorithms for real-world deployment.


title: A Biologically Plausible Learning Rule for Perceptual Systems of organisms that Maximize Mutual Information

abstract: It is widely believed that the perceptual system of an organism is optimized for the properties of the environment to which it is exposed. A specific instance of this principle known as the Infomax principle holds that the purpose of early perceptual processing is to maximize the mutual information between the neural coding and the incoming sensory signal. In this article, we present a method to implement this principle accurately with a local, spike-based, and continuous-time learning rule.


title: Efficiently solving the thief orienteering problem with a max-min ant colony optimization approach

abstract: We tackle the Thief Orienteering Problem (ThOP), an academic multi-component problem that combines two classical combinatorial problems, namely the Knapsack Problem and the Orienteering Problem. In the ThOP, a thief has a time limit to steal items that distributed in a given set of cities. While traveling, the thief collects items by storing them in their knapsack, which in turn reduces the travel speed. The thief has as the objective to maximize the total profit of the stolen items. In this article, we present an approach that combines swarm-intelligence with a randomized packing heuristic. Our solution approach outperforms existing works on almost all the 432 benchmarking instances, with significant improvements.


title: KNN-Averaging for Noisy Multi-objective Optimisation

abstract: Multi-objective optimisation is a popular approach for finding solutions to complex problems with large search spaces that reliably yields good optimisation results. However, with the rise of cyber-physical systems, emerges a new challenge of noisy fitness functions, whose objective value for a given configuration is non-deterministic, producing varying results on each execution. This leads to an optimisation process that is based on stochastically sampled information, ultimately favouring solutions with fitness values that have co-incidentally high outlier noise. In turn, the results are unfaithful due to their large discrepancies between sampled and expectable objective values. Motivated by our work on noisy automated driving systems, we present the results of our ongoing research to counteract the effect of noisy fitness functions without requiring repeated executions of each solution. Our method kNN-Avg identifies the k-nearest neighbours of a solution point and uses the weighted average value as a surrogate for its actually sampled fitness. We demonstrate the viability of kNN-Avg on common benchmark problems and show that it produces comparably good solutions whose fitness values are closer to the expected value.


title: Does referent predictability affect the choice of referential form? A computational approach using masked coreference resolution

abstract: It is often posited that more predictable parts of a speaker's meaning tend to be made less explicit, for instance using shorter, less informative words. Studying these dynamics in the domain of referring expressions has proven difficult, with existing studies, both psycholinguistic and corpus-based, providing contradictory results. We test the hypothesis that speakers produce less informative referring expressions (e.g., pronouns vs. full noun phrases) when the context is more informative about the referent, using novel computational estimates of referent predictability. We obtain these estimates training an existing coreference resolution system for English on a new task, masked coreference resolution, giving us a probability distribution over referents that is conditioned on the context but not the referring expression. The resulting system retains standard coreference resolution performance while yielding a better estimate of human-derived referent predictability than previous attempts. A statistical analysis of the relationship between model output and mention form supports the hypothesis that predictability affects the form of a mention, both its morphosyntactic type and its length.


title: Bisections of mass assignments using flags of affine spaces

abstract: We use recent extensions of the Borsuk--Ulam theorem for Stiefel manifolds to generalize the ham sandwich theorem to mass assignments. A $k$-dimensional mass assignment continuously imposes a measure on each $k$-dimensional affine subspace of $\mathbb{R}^d$. Given a finite collection of mass assignments of different dimensions, one may ask if there is some sequence of affine subspaces $S_{k-1} \subset S_k \subset \ldots \subset S_{d-1} \subset \mathbb{R}^d$ such that $S_i$ bisects all the mass assignments on $S_{i+1}$ for every $i$. We show it is possible to do so whenever the number of mass assignments of dimensions $(k,\ldots,d)$ is a permutation of $(k,\ldots,d)$. We extend previous work on mass assignments and the central transversal theorem. We also study the problem of halving several families of $(d-k)$-dimensional affine spaces of $\mathbb{R}^d$ using a $(k-1)$-dimensional affine subspace contained in some translate of a fixed $k$-dimensional affine space. For $k=d-1$, there results can be interpreted as dynamic ham sandwich theorems for families of moving points.


title: Evolving Digital Circuits for the Knapsack Problem

abstract: Multi Expression Programming (MEP) is a Genetic Programming variant that uses linear chromosomes for solution encoding. A unique feature of MEP is its ability of encoding multiple solutions of a problem in a single chromosome. In this paper we use Multi Expression Programming for evolving digital circuits for a well-known NP-Complete problem: the knapsack (subset sum) problem. Numerical experiments show that Multi Expression Programming performs well on the considered test problems.


title: Quantitative bounds for the $U^4$-inverse theorem over low characteristic finite fields

abstract: This paper gives the first quantitative bounds for the inverse theorem for the Gowers $U^4$-norm over $\mathbb{F}_p^n$ when $p=2,3$. We build upon earlier work of Gowers and Mili\'cevi\'c who solved the corresponding problem for $p\geq 5$. Our proof has two main steps: symmetrization and integration of low-characteristic trilinear forms. We are able to solve the integration problem for all $k$-linear forms, but the symmetrization problem we are only able to solve for trilinear forms. We pose several open problems about symmetrization of low-characteristic $k$-linear forms whose resolution, combined with recent work of Gowers and Mili\'cevi\'c, would give quantitative bounds for the inverse theorem for the Gowers $U^{k+1}$-norm over $\mathbb{F}_p^n$ for all $k,p$.


title: Evolving winning strategies for Nim-like games

abstract: An evolutionary approach for computing the winning strategy for Nim-like games is proposed in this paper. The winning strategy is computed by using the Multi Expression Programming (MEP) technique - a fast and efficient variant of the Genetic Programming (GP). Each play strategy is represented by a mathematical expression that contains mathematical operators (such as +, -, *, mod, div, and , or, xor, not) and operands (encoding the current game state). Several numerical experiments for computing the winning strategy for the Nim game are performed. The computational effort needed for evolving a winning strategy is reported. The results show that the proposed evolutionary approach is very suitable for computing the winning strategy for Nim-like games.


title: Evolving Evolutionary Algorithms using Linear Genetic Programming

abstract: A new model for evolving Evolutionary Algorithms is proposed in this paper. The model is based on the Linear Genetic Programming (LGP) technique. Every LGP chromosome encodes an EA which is used for solving a particular problem. Several Evolutionary Algorithms for function optimization, the Traveling Salesman Problem, and the Quadratic Assignment Problem are evolved by using the considered model. Numerical experiments show that the evolved Evolutionary Algorithms perform similarly and sometimes even better than standard approaches for several well-known benchmarking problems.


title: Modeling electronic response properties with an explicit-electron machine learning potential

abstract: Explicit-electron force fields introduce electrons or electron pairs as semi-classical particles in force fields or empirical potentials, which are suitable for molecular dynamics simulations. Even though semi-classical electrons are a drastic simplification compared to a quantum-mechanical electronic wavefunction, they still retain a relatively detailed electronic model compared to conventional polarizable and reactive force fields. The ability of explicit-electron models to describe chemical reactions and electronic response properties has already been demonstrated, yet the description of short-range interactions for a broad range of chemical systems remains challenging. In this work, we present the electron machine learning potential (eMLP), a new explicit electron force field where the short-range interactions are modeled with machine learning. The electron pair particles will be located at well-defined positions, derived from localized molecular orbitals or Wannier centers, naturally imposing the correct dielectric and piezoelectric behavior of the system. The eMLP is benchmarked on two newly constructed datasets: eQM7, a extension of the QM7 dataset for small molecules, and a dataset for the crystalline $\beta$-glycine. It is shown that the eMLP can predict dipole moments, polarizabilities and IR-spectra of unseen molecules with high precision. Furthermore, a variety of response properties, e.g. stiffness or piezoelectric constants, can be accurately reproduced.


title: Recall and Learn: A Memory-augmented Solver for Math Word Problems

abstract: In this article, we tackle the math word problem, namely, automatically answering a mathematical problem according to its textual description. Although recent methods have demonstrated their promising results, most of these methods are based on template-based generation scheme which results in limited generalization capability. To this end, we propose a novel human-like analogical learning method in a recall and learn manner. Our proposed framework is composed of modules of memory, representation, analogy, and reasoning, which are designed to make a new exercise by referring to the exercises learned in the past. Specifically, given a math word problem, the model first retrieves similar questions by a memory module and then encodes the unsolved problem and each retrieved question using a representation module. Moreover, to solve the problem in a way of analogy, an analogy module and a reasoning module with a copy mechanism are proposed to model the interrelationship between the problem and each retrieved question. Extensive experiments on two well-known datasets show the superiority of our proposed algorithm as compared to other state-of-the-art competitors from both overall performance comparison and micro-scope studies.


title: Can You See Me Now? A Measurement Study of Zoom, Webex, and Meet

abstract: Since the outbreak of the COVID-19 pandemic, videoconferencing has become the default mode of communication in our daily lives at homes, workplaces and schools, and it is likely to remain an important part of our lives in the post-pandemic world. Despite its significance, there has not been any systematic study characterizing the user-perceived performance of existing videoconferencing systems other than anecdotal reports. In this paper, we present a detailed measurement study that compares three major videoconferencing systems: Zoom, Webex and Google Meet. Our study is based on 48 hours' worth of more than 700 videoconferencing sessions, which were created with a mix of emulated videoconferencing clients deployed in the cloud, as well as real mobile devices running from a residential network. We find that the existing videoconferencing systems vary in terms of geographic scope, which in turns determines streaming lag experienced by users. We also observe that streaming rate can change under different conditions (e.g., number of users in a session, mobile device status, etc), which affects user-perceived streaming quality. Beyond these findings, our measurement methodology can enable reproducible benchmark analysis for any types of comparative or longitudinal study on available videoconferencing systems.


title: Determination of $\alpha_{S}$ beyond $NNLO$ using the event shape averages

abstract: In this proceedings we discuss a prescription to extract the QCD strong coupling constant at $N^{3}LO$ precision in perturbative QCD using a combination of ${\cal{O}}(\alpha_{S}^{3})$ calculations in pQCD and estimations of the ${\cal{O}}(\alpha_{S}^{4})$ corrections from the data. The method is applied to a set of event shape averages measured in experiments at the LEP, PETRA, PEP and TRISTAN colliders. In our analysis we account for hadronization effects with models from modern Monte Carlo event generators and analytic hadronization models. We conclude that the precision of the $\alpha_{S}$ extraction cannot be improved significantly only with pQCD predictions of higher orders, and further progress in these studies requires a significant advances in the studies and modeling of hadronization process.


title: Isochrone fitting of Galactic globular clusters -- III. NGC\,288, NGC\,362, and NGC\,6218 (M12)

abstract: We present new isochrone fits to colour-magnitude diagrams of the Galactic globular clusters NGC\,288, NGC\,362, and NGC\,6218 (M12). We utilize a lot of photometric bands from the ultraviolet to mid-infrared by use of data from the {\it HST}, {\it Gaia}, unWISE, Pan-STARRS, and other photometric sources. In our isochrone fitting we use theoretical models and isochrones from the Dartmouth Stellar Evolution Program and Bag of Stellar Tracks and Isochrones for $\alpha$-enhanced abundance [$\alpha$/Fe]$=+0.40$, different helium abundances, and a metallicity of about [Fe/H]$=-1.3$ adopted from the literature. We derive the most probable distances $8.96\pm0.05$, $8.98\pm0.06$, and $5.04\pm0.05$ kpc, ages $13.5\pm1.1$, $11.0\pm0.6$, and $13.8\pm1.1$ Gyr, extinctions $A_\mathrm{V}=0.08\pm0.03$, $0.11\pm0.04$, and $0.63\pm0.03$ mag, and reddenings $E(B-V)=0.014\pm0.010$, $0.028\pm0.011$, and $0.189\pm0.010$ mag for NGC\,288, NGC\,362, and NGC\,6218, respectively. The distance estimates from the different models are consistent, while those of age, extinction, and reddening are not. The uncertainties of age, extinction, and reddening are dominated by some intrinsic systematic differences between the models. However, the models agree in their relative age estimates: NGC\,362 is $2.6\pm0.5$ Gyr younger than NGC\,288 and $2.8\pm0.5$ Gyr younger than NGC\,6218, confirming age as the second parameter for these clusters. We provide reliable lists of the cluster members and precise cluster proper motions from the {\it Gaia} Early Data Release 3.


title: VQA-MHUG: A Gaze Dataset to Study Multimodal Neural Attention in Visual Question Answering

abstract: We present VQA-MHUG - a novel 49-participant dataset of multimodal human gaze on both images and questions during visual question answering (VQA) collected using a high-speed eye tracker. We use our dataset to analyze the similarity between human and neural attentive strategies learned by five state-of-the-art VQA models: Modular Co-Attention Network (MCAN) with either grid or region features, Pythia, Bilinear Attention Network (BAN), and the Multimodal Factorized Bilinear Pooling Network (MFB). While prior work has focused on studying the image modality, our analyses show - for the first time - that for all models, higher correlation with human attention on text is a significant predictor of VQA performance. This finding points at a potential for improving VQA performance and, at the same time, calls for further research on neural text attention mechanisms and their integration into architectures for vision and language tasks, including but potentially also beyond VQA.


title: The cohomology of the mod 2 Steenrod algebra

abstract: A minimal resolution of the mod 2 Steenrod algebra in the range $0 \leq s \leq 128$, $0 \leq t \leq 200$, together with chain maps for each cocycle in that range and for the squaring operation $Sq^0$ in the cohomology of the Steenrod algebra.


title: X-ray Intraday Variability and Power Spectral Density Profiles of the Blazar 3C 273 with XMM-Newton during 2000-2021

abstract: We present X-ray intraday variability and power spectral density (PSD) analyses of the longest 23 pointed XMM-Newton observations of the blazar 3C 273 that were taken during 2000 -- 2021. These good time intervals contained between 5 and 24.6 hours of data. Variability has been estimated in three energy bands: 0.2 -- 2 keV (soft), 2 -- 10 keV (hard), and 0.2 -- 10 keV (total). Nine of the 23 observations exhibited some variability, though no major variations exceeding 5 per cent were detected. Typical timescales for variability were $\sim 1$ ks. For those variable light curves we find that a power-law model provides good fits to each PSD, with most of the slopes between $-1.7$ and $-2.8$. Although no variations of hardness ratio could be measured in any individual observation, an anti-correlation in flux and hardness ratio is found in long term data that indicates a harder when brighter trend. Our flux and spectral analyses indicate that both particle acceleration and synchrotron cooling processes make an important contribution to the emission from this blazar.


title: Plane-Wave Ultrasound Beamforming: A Deep Learning Approach

abstract: Medical ultrasound provides images which are the spatial map of the tissue echogenicity. Unfortunately, an ultrasound image is a low-quality version of the expected Tissue Reflectivity Function (TRF) mainly due to the non-ideal Point Spread Function (PSF) of the imaging system. This paper presents a novel beamforming approach based on deep learning to get closer to the ideal PSF in Plane-Wave Imaging (PWI). The proposed approach is designed to reconstruct the desired TRF from echo traces acquired by transducer elements using only a single plane-wave transmission. In this approach, first, an ideal model for the TRF is introduced by setting the imaging PSF as a sharp Gaussian function. Then, a mapping function between the pre-beamformed Radio-Frequency (RF) channel data and the proposed TRF is constructed using deep learning. Network architecture contains multi-resolution decomposition and reconstruction using wavelet transform for effective recovery of high-frequency content of the desired TRF. Inspired by curriculum learning, we exploit step by step training from coarse (mean square error) to fine ($\ell_{0.2}$) loss functions. The proposed method is trained on a large number of simulation ultrasound data with the ground-truth echogenicity map extracted from real photographic images. The performance of the trained network is evaluated on the publicly available simulation and \textit{in vivo} test data without any further fine-tuning. Simulation test results confirm that the proposed method reconstructs images with a high quality in terms of resolution and contrast, which are also visually similar to the proposed ground-truth image. Furthermore, \textit{in vivo} results show that the trained mapping function preserves its performance in the new domain. Therefore, the proposed approach maintains high resolution, contrast, and framerate simultaneously.


title: An End-to-end Entangled Segmentation and Classification Convolutional Neural Network for Periodontitis Stage Grading from Periapical Radiographic Images

abstract: Periodontitis is a biofilm-related chronic inflammatory disease characterized by gingivitis and bone loss in the teeth area. Approximately 61 million adults over 30 suffer from periodontitis (42.2%), with 7.8% having severe periodontitis in the United States. The measurement of radiographic bone loss (RBL) is necessary to make a correct periodontal diagnosis, especially if the comprehensive and longitudinal periodontal mapping is unavailable. However, doctors can interpret X-rays differently depending on their experience and knowledge. Computerized diagnosis support for doctors sheds light on making the diagnosis with high accuracy and consistency and drawing up an appropriate treatment plan for preventing or controlling periodontitis. We developed an end-to-end deep learning network HYNETS (Hybrid NETwork for pEriodoNTiTiS STagES from radiograpH) by integrating segmentation and classification tasks for grading periodontitis from periapical radiographic images. HYNETS leverages a multi-task learning strategy by combining a set of segmentation networks and a classification network to provide an end-to-end interpretable solution and highly accurate and consistent results. HYNETS achieved the average dice coefficient of 0.96 and 0.94 for the bone area and tooth segmentation and the average AUC of 0.97 for periodontitis stage assignment. Additionally, conventional image processing techniques provide RBL measurements and build transparency and trust in the model's prediction. HYNETS will potentially transform clinical diagnosis from a manual time-consuming, and error-prone task to an efficient and automated periodontitis stage assignment based on periapical radiographic images.


title: Spin Quantization in Heavy Ion Collision

abstract: We analyzed recent experimental data on the disassembly of $^{28}$Si into 7$\alpha$ in terms of a hybrid $\alpha$-cluster model. We calculated the probability of breaking into several $\alpha$-like fragments for high $l$-spin values for identical and non-identical spin zero nuclei. Resonant energies were found for each $l$-value and compared to the data and other theoretical models. Toroidal-like structures were revealed in coordinate and momentum space when averaging over many events at high $l$. The transition from quantum to classical mechanics is highlighted.


title: Speeding-up One-vs-All Training for Extreme Classification via Smart Initialization

abstract: In this paper we show that a simple, data dependent way of setting the initial vector can be used to substantially speed up the training of linear one-versus-all (OVA) classifiers in extreme multi-label classification (XMC). We discuss the problem of choosing the initial weights from the perspective of three goals. We want to start in a region of weight space a) with low loss value, b) that is favourable for second-order optimization, and c) where the conjugate-gradient (CG) calculations can be performed quickly. For margin losses, such an initialization is achieved by selecting the initial vector such that it separates the mean of all positive (relevant for a label) instances from the mean of all negatives -- two quantities that can be calculated quickly for the highly imbalanced binary problems occurring in XMC. We demonstrate a speedup of $\approx 3\times$ for training with squared hinge loss on a variety of XMC datasets. This comes in part from the reduced number of iterations that need to be performed due to starting closer to the solution, and in part from an implicit negative mining effect that allows to ignore easy negatives in the CG step. Because of the convex nature of the optimization problem, the speedup is achieved without any degradation in classification accuracy.


title: Automatic Generation of Word Problems for Academic Education via Natural Language Processing (NLP)

abstract: Digital learning platforms enable students to learn on a flexible and individual schedule as well as providing instant feedback mechanisms. The field of STEM education requires students to solve numerous training exercises to grasp underlying concepts. It is apparent that there are restrictions in current online education in terms of exercise diversity and individuality. Many exercises show little variance in structure and content, hindering the adoption of abstraction capabilities by students. This thesis proposes an approach to generate diverse, context rich word problems. In addition to requiring the generated language to be grammatically correct, the nature of word problems implies additional constraints on the validity of contents. The proposed approach is proven to be effective in generating valid word problems for mathematical statistics. The experimental results present a tradeoff between generation time and exercise validity. The system can easily be parametrized to handle this tradeoff according to the requirements of specific use cases.


title: Parameterising the effect of a continuous exposure using average derivative effects

abstract: The (weighted) average treatment effect is commonly used to quantify the main effect of a binary exposure on an outcome. Extensions to continuous exposures, however, either quantify the effects of interventions that are rarely relevant (e.g., applying the same exposure level uniformly in the population), or consider shift interventions that are rarely intended, raising the question how large a shift to consider. Average derivative effects (ADEs) instead express the effect of an infinitesimal shift in each subject's exposure level, making inference less prone to extrapolation. ADEs, however, are rarely considered in practice because their estimation usually requires estimation of (a) the conditional density of exposure given covariates, and (b) the derivative of (a) w.r.t. exposure. Here, we introduce a class of estimands which can be inferred without requiring estimates of (a) and (b), but which reduce to ADEs when the exposure obeys a specific distribution determined by the choice of estimand in the class. We moreover show that when the exposure does not obey this distribution, our estimand represents an ADE w.r.t. an `intervention' exposure distribution. We identify the `optimal' estimand in our class and propose debiased machine learning estimators, by deriving influence functions under the nonparametric model.


title: Three years of muography at Mount Etna: results and perspectives

abstract: The Summit Craters system represents the point of maximum expression of the persistent tectonic activity at Mount Etna Volcano. The Muography of Etna Volcano (MEV) Project began in 2016 as a pilot project for the successive installation of a permanent muographic observatory. It aims to demonstrate the detector's capability to observe density anomalies inside the volcanic edifice and monitor their time evolution. The first muon telescope built by the collaboration and installed at the base of the North-East Crater from August 2017 to October 2019 was already able to get significant results. This work describes the characteristics of the muon-telescope and summarizes the principal outcomes obtained, with a quick look at the current status of the project and future developments.


title: GANiry: Bald-to-Hairy Translation Using CycleGAN

abstract: This work presents our computer vision course project called bald men-to-hairy men translation using CycleGAN. On top of CycleGAN architecture, we utilize perceptual loss in order to achieve more realistic results. We also integrate conditional constrains to obtain different stylized and colored hairs on bald men. We conducted extensive experiments and present qualitative results in this paper. Our code and models are available at https://github.com/fidansamet/GANiry.


title: Self-interacting random walks : aging, exploration and first-passage times

abstract: Self-interacting random walks are endowed with long range memory effects that emerge from the interaction of the random walker at time $t$ with the territory that it has visited at earlier times $t'<t$. This class of non Markovian random walks has applications in a broad range of examples, ranging from insects to living cells, where a random walker modifies locally its environment -- leaving behind footprints along its path, and in turn responds to its own footprints. Because of their inherent non Markovian nature, the exploration properties of self-interacting random walks have remained elusive. Here we show that long range memory effects can have deep consequences on the dynamics of generic self-interacting random walks ; they can induce aging and non trivial persistence and transience exponents, which we determine quantitatively, in both infinite and confined geometries. Based on this analysis, we quantify the search kinetics of self-interacting random walkers and show that the distribution of the first-passage time (FPT) to a target site in a confined domain takes universal scaling forms in the large domain size limit, which we characterize quantitatively. We argue that memory abilities induced by attractive self-interactions provide a decisive advantage for local space exploration, while repulsive self-interactions can significantly accelerate the global exploration of large domains.


title: Generalized Ising Model on a Scale-Free Network: An Interplay of Power Laws

abstract: We consider a recently introduced generalization of the Ising model in which individual spin strength can vary. The model is intended for analysis of ordering in systems comprising agents which, although matching in their binarity (i.e., maintaining the iconic Ising features of `+' or `$-$', `up' or `down', `yes' or `no'), differ in their strength. To investigate the interplay between variable properties of nodes and interactions between them, we study the model on a complex network where both the spin strength and degree distributions are governed by power laws. We show that in the annealed network approximation, thermodynamic functions of the model are self-averaging and we obtain an exact solution for the partition function. This allows us to derive the leading temperature and field dependencies of thermodynamic functions, their critical behavior, and logarithmic corrections at the interface of different phases. We find the delicate interplay of the two power laws leads to new universality classes.


title: Disentangling positive and negative partisanship in social media interactions using a coevolving latent space network with attractors model

abstract: We develop a broadly applicable class of coevolving latent space network with attractors (CLSNA) models, where nodes represent individual social actors assumed to lie in an unknown latent space, edges represent the presence of a specified interaction between actors, and attractors are added in the latent level to capture the notion of attractive and repulsive forces. We apply the CLSNA models to understand the dynamics of partisan polarization on social media, where we expect Republicans and Democrats to increasingly interact with their own party and disengage with the opposing party. Using longitudinal social networks from the social media platforms Twitter and Reddit, we investigate the relative contributions of positive (attractive) and negative (repulsive) forces among political elites and the public, respectively. Our goals are to disentangle the positive and negative forces within and between parties and explore if and how they change over time. Our analysis confirms the existence of partisan polarization in social media interactions among both political elites and the public. Moreover, while positive partisanship is the driving force of interactions across the full periods of study for both the public and Democratic elites, negative partisanship has come to dominate Republican elites' interactions since the run-up to the 2016 presidential election.


title: Designing spin-textured flat bands in twisted graphene multilayers via helimagnet encapsulation

abstract: Twisted graphene multilayers provide tunable platforms to engineer flat bands and exploit the associated strongly correlated physics. The two-dimensional nature of these systems makes them suitable for encapsulation by materials that break specific symmetries. In this context, recently discovered two-dimensional helimagnets, such as the multiferroic monolayer NiI$_2$, are specially appealing for breaking time-reversal and inversion symmetries due to their nontrivial spin textures. Here we show that this spin texture can be imprinted on the electronic structure of twisted bilayer graphene by proximity effect. We discuss the dependence of the imprinted spin texture on the wave-vector of the helical structure, and on the strength of the effective local exchange field. Based on these results we discuss the nature of the superconducting instabilities that can take place in helimagnet encapsulated twisted bilayer graphene. Our results put forward helimagnetic encapsulation as a powerful way of designing spin-textured flat band systems, providing a starting point to engineer a new family of correlated moire states.


title: Graphs with high second eigenvalue multiplicity

abstract: Jiang, Tidor, Yao, Zhang, and Zhao recently showed that connected bounded degree graphs have sublinear second eigenvalue multiplicity (always referring to the adjacency matrix). This result was a key step in the solution to the problem of equiangular lines with fixed angles. It led to the natural question: what is the maximum second eigenvalue multiplicity of a connected bounded degree $n$-vertex graph? The best known upper bound is $O(n/\log\log n)$. The previously known best known lower bound is on the order of $n^{1/3}$ (for infinitely many $n$), coming from Cayley graphs on $\text{PSL}(2,q)$. Here we give constructions showing a lower bound on the order of $\sqrt{n/\log n}$. We also construct Cayley graphs with second eigenvalue multiplicity at least $n^{2/5}-1$. Earlier techniques show that there are at most $O(n/\log\log n)$ eigenvalues (counting multiplicities) within $O(1/\log n)$ of the second eigenvalue. We give a construction showing this upper bound on approximate second eigenvalue multiplicity is tight up to a constant factor. This demonstrates a barrier to earlier techniques for upper bounding eigenvalue multiplicities.


title: Optimization Landscape of Gradient Descent for Discrete-time Static Output Feedback

abstract: In this paper, we analyze the optimization landscape of gradient descent methods for static output feedback (SOF) control of discrete-time linear time-invariant systems with quadratic cost. The SOF setting can be quite common, for example, when there are unmodeled hidden states in the underlying process. We first establish several important properties of the SOF cost function, including coercivity, L-smoothness, and M-Lipschitz continuous Hessian. We then utilize these properties to show that the gradient descent is able to converge to a stationary point at a dimension-free rate. Furthermore, we prove that under some mild conditions, gradient descent converges linearly to a local minimum if the starting point is close to one. These results not only characterize the performance of gradient descent in optimizing the SOF problem, but also shed light on the efficiency of general policy gradient methods in reinforcement learning.


title: Rich groups, weak second order logic, and applications

abstract: In this paper we initiate a study of first-order rich groups, i.e., groups where the first-order logic has the same power as the weak second order logic. Surprisingly, there are quite a lot of finitely generated rich groups, they are somewhere in between hyperbolic and nilpotent groups (these ones are not rich). We provide some methods to prove that groups (and other structures) are rich and describe some of their properties. As corollaries we look at Malcev's problems in various groups.


title: A driven fractal network: Possible route to efficient thermoelectric application

abstract: An essential attribute of many fractal structures is self-similarity. A Sierpinski gasket (SPG) triangle is a promising example of a fractal lattice that exhibits localized energy eigenstates. In the present work, for the first time we establish that a mixture of both extended and localized energy eigenstates can be generated yeilding mobility edges at multiple energies in presence of a time-periodic driving field. We obtain several compelling features by studying the transmission and energy eigenvalue spectra. As a possible application of our new findings, different thermoelectric properties are discussed, such as electrical conductance, thermopower, thermal conductance due to electrons and phonons. We show that our proposed method indeed exhibits highly favorable thermoelectric performance. The time-periodic driving field is assumed through an arbitrarily polarized light, and its effect is incorporated via Floquet-Bloch ansatz. All transport phenomena are worked out using Green's function formalism following the Landauer-B\"{u}ttiker prescription.

categories: cond-mat.mes-hall cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.other quant-ph


title: Spin-dependent transport in a driven noncolinear antiferromagnetic fractal network

abstract: Noncolinear magnetic texture breaks the spin-sublattice symmetry which gives rise to a spin-splitting effect. Inspired by this, we study the spin-dependent transport properties in a noncolinear antiferromagnetic fractal structure, namely, the Sierpinski Gasket (SPG) triangle. We find that though the spin-up and spin-down currents are different, the degree of spin polarization is too weak. Finally, we come up with a proposal, where the degree of spin polarization can be enhanced significantly in the presence of a time-periodic driving field. Such a prescription of getting spin-filtering effect from an unpolarized source in a fractal network is completely new to the best of our knowledge. Starting from a higher generation of SPG to smaller ones, the precise dependencies of driving field parameters, spin-dependent scattering strength, interface sensitivity on spin polarization are critically investigated. The spatial distribution of spin-resolved bond current density is also explored. Interestingly, our proposed setup exhibits finite spin polarization for different spin-quantization axes. Arbitrarily polarized light is considered and its effect is incorporated through Floquet-Bloch ansatz. All the spin-resolved transport quantities are computed using Green's function formalism following the Landauer-B\"{u}ttiker prescription. The present work brings forth new insights into spintronic properties of noncolinear antiferromagnetic SPG and should entice the AFM spintronic community to explore other fractal structures with the possibility of unconventional features.


title: Construction of minimal annuli in PSL2 via a variational method

abstract: We construct complete, embedded minimal annuli asymptotic to vertical planes in the Riemannian 3-manifold PSL. The boundary of these annuli consists of 4 vertical lines at infinity. They are constructed by taking the limit of a sequence of compact minimal annuli. The compactness is obtained from an estimate of curvature which uses foliations by minimal surfaces. This estimate is independent of the index of the surface. We also prove the existence of a one-periodic family of Riemann's type examples. The difficulty of the construction comes from the lack of symmetry of the ambient space PSL.


title: Mitigating Racial Biases in Toxic Language Detection with an Equity-Based Ensemble Framework

abstract: Recent research has demonstrated how racial biases against users who write African American English exists in popular toxic language datasets. While previous work has focused on a single fairness criteria, we propose to use additional descriptive fairness metrics to better understand the source of these biases. We demonstrate that different benchmark classifiers, as well as two in-process bias-remediation techniques, propagate racial biases even in a larger corpus. We then propose a novel ensemble-framework that uses a specialized classifier that is fine-tuned to the African American English dialect. We show that our proposed framework substantially reduces the racial biases that the model learns from these datasets. We demonstrate how the ensemble framework improves fairness metrics across all sample datasets with minimal impact on the classification performance, and provide empirical evidence in its ability to unlearn the annotation biases towards authors who use African American English. ** Please note that this work may contain examples of offensive words and phrases.


title: On Kosloff Tal-Ezer Least-Squares Quadrature Formulas

abstract: In this work, we study a global quadrature scheme for analytic functions on compact intervals based on function values on quasi-uniform grids of quadrature nodes. In practice it is not always possible to sample functions at optimal nodes that give well-conditioned and quickly converging interpolatory quadrature rules at the same time. Therefore, we go beyond classical interpolatory quadrature by lowering the degree of the polynomial approximant and by applying auxiliary mapping functions that map the original quadrature nodes to more suitable fake nodes. More precisely, we investigate the combination of the Kosloff Tal-Ezer map and least-squares approximation (KTL) for numerical quadrature: a careful selection of the mapping parameter ensures stability of the scheme, a high accuracy of the approximation and, at the same time, an asymptotically optimal ratio between the degree of the polynomial and the spacing of the grid. We will investigate the properties of this KTL quadrature and focus on the symmetry of the quadrature weights, the limit relations for the mapping parameter, as well as the computation of the quadrature weights in the standard monomial and in the Chebyshev bases with help of a cosine transform. Numerical tests on equispaced nodes show that a static choice of the map's parameter improve the results of the composite trapezoidal rule, while a dynamic approach achieves larger stability and faster convergence, even when the sampling nodes are perturbed. From a computational point of view the proposed method is practical and can be implemented in a simple and efficient way.


title: Multimodal Integration of Human-Like Attention in Visual Question Answering

abstract: Human-like attention as a supervisory signal to guide neural attention has shown significant promise but is currently limited to uni-modal integration - even for inherently multimodal tasks such as visual question answering (VQA). We present the Multimodal Human-like Attention Network (MULAN) - the first method for multimodal integration of human-like attention on image and text during training of VQA models. MULAN integrates attention predictions from two state-of-the-art text and image saliency models into neural self-attention layers of a recent transformer-based VQA model. Through evaluations on the challenging VQAv2 dataset, we show that MULAN achieves a new state-of-the-art performance of 73.98% accuracy on test-std and 73.72% on test-dev and, at the same time, has approximately 80% fewer trainable parameters than prior work. Overall, our work underlines the potential of integrating multimodal human-like and neural attention for VQA