title: Multi-messenger-Athena Synergy White Paper

abstract: In this paper we explore the scientific synergies between Athena and some of the key multi-messenger facilities that should be operative concurrently with Athena. These facilities include LIGO A+, Advanced Virgo+ and future detectors for ground-based observation of gravitational waves (GW), LISA for space-based observations of GW, IceCube and KM3NeT for neutrino observations, and CTA for very high energy observations. These science themes encompass pressing issues in astrophysics, cosmology and fundamental physics such as: the central engine and jet physics in compact binary mergers, accretion processes and jet physics in Super-Massive Binary Black Holes (SMBBHs) and in compact stellar binaries, the equation of state of neutron stars, cosmic accelerators and the origin of Cosmic Rays (CRs), the origin of intermediate and high-Z elements in the Universe, the Cosmic distance scale and tests of General Relativity and the Standard Model. Observational strategies for implementing the identified science topics are also discussed. A significant part of the sources targeted by multi-messenger facilities is of transient nature. We have thus also discussed the synergy of \textsl{Athena} with wide-field high-energy facilities, taking THESEUS as a case study for transient discovery. This discussion covers all the Athena science goals that rely on follow-up observations of high-energy transients identified by external observatories, and includes also topics that are not based on multi-messenger observations, such as the search for missing baryons or the observation of early star populations and metal enrichment at the cosmic dawn with Gamma-Ray Bursts (GRBs).


title: A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis

abstract: The advancement of generative radiance fields has pushed the boundary of 3D-aware image synthesis. Motivated by the observation that a 3D object should look realistic from multiple viewpoints, these methods introduce a multi-view constraint as regularization to learn valid 3D radiance fields from 2D images. Despite the progress, they often fall short of capturing accurate 3D shapes due to the shape-color ambiguity, limiting their applicability in downstream tasks. In this work, we address this ambiguity by proposing a novel shading-guided generative implicit model that is able to learn a starkly improved shape representation. Our key insight is that an accurate 3D shape should also yield a realistic rendering under different lighting conditions. This multi-lighting constraint is realized by modeling illumination explicitly and performing shading with various lighting conditions. Gradients are derived by feeding the synthesized images to a discriminator. To compensate for the additional computational burden of calculating surface normals, we further devise an efficient volume rendering strategy via surface tracking, reducing the training and inference time by 24% and 48%, respectively. Our experiments on multiple datasets show that the proposed approach achieves photorealistic 3D-aware image synthesis while capturing accurate underlying 3D shapes. We demonstrate improved performance of our approach on 3D shape reconstruction against existing methods, and show its applicability on image relighting. Our code will be released at https://github.com/XingangPan/ShadeGAN.


title: Giant and robust topological Hall effect in Chiral Magnet Co7Zn8Mn5

abstract: Recently, \b{eta}-Mn-type Co-Zn-Mn alloys have gained particular attentions as a new class of chiral magnets hosting skyrmion phase. In this work, a giant topological Hall effect(THE)is observed during the wide temperature range below 220 K in the chiral magnet Co7Zn8Mn5. The maximum topological Hall resistivity, -2.1 {\mu}{\Omega} cm, is obtained at 10 K. Moreover, the observed THE effect persists up to Tc, which is mainly derived from the noncoplanar spin structure with scalar spin chirality. In contrast, the formation of skyrmion phase is substantiated at the temperature interval slightly below Tc by adopting the magnetization and ac-susceptibility. Further, the possible signal of skyrmion-conical coexisting phase is found based on the out-of-phase component in magnetoelastic measurements. These results strongly suggest the chiral magnet Co7Zn8Mn5 compound should be an excellent candidate to study the topological magnetic properties and high temperature skyrmions.


title: Breaking Buchdahl: ultracompact stars in semiclassical gravity

abstract: The semiclassical approximation takes into account the gravitational contribution of zero-point energies. We model this contribution via the renormalized stress-energy tensor (RSET) of a massless scalar field, which we compute in a cutoff-regularized version of the Polyakov approximation. When the field is in the Boulware vacuum state (the natural vacuum for stellar geometries), the RSET works in favor of violating the Buchdahl compactness limit. We review the family of classical constant-density stellar solutions, paying particular attention to the notion of criticality -- the presence of offsets in the mass function -- and use it as a warm up for the analysis of the semiclassical set of solutions. For stars that surpass Buchdahl limit by far, the critical solution has an irregular pressure. This divergence in pressure moves inward by introducing a negative offset in the mass. In the semiclassical theory we find something rather different, namely that the critical configuration already displays a pressure that diverges exactly at the center of the structure. This drastic difference between the classical and semiclassical space of solutions suggests that semiclassical gravity could potentially allow for the existence of ultracompact stellar objects.


title: False Positive Detection and Prediction Quality Estimation for LiDAR Point Cloud Segmentation

abstract: We present a novel post-processing tool for semantic segmentation of LiDAR point cloud data, called LidarMetaSeg, which estimates the prediction quality segmentwise. For this purpose we compute dispersion measures based on network probability outputs as well as feature measures based on point cloud input features and aggregate them on segment level. These aggregated measures are used to train a meta classification model to predict whether a predicted segment is a false positive or not and a meta regression model to predict the segmentwise intersection over union. Both models can then be applied to semantic segmentation inferences without knowing the ground truth. In our experiments we use different LiDAR segmentation models and datasets and analyze the power of our method. We show that our results outperform other standard approaches.


title: Overview of ADoBo 2021: Automatic Detection of Unassimilated Borrowings in the Spanish Press

abstract: This paper summarizes the main findings of the ADoBo 2021 shared task, proposed in the context of IberLef 2021. In this task, we invited participants to detect lexical borrowings (coming mostly from English) in Spanish newswire texts. This task was framed as a sequence classification problem using BIO encoding. We provided participants with an annotated corpus of lexical borrowings which we split into training, development and test splits. We received submissions from 4 teams with 9 different system runs overall. The results, which range from F1 scores of 37 to 85, suggest that this is a challenging task, especially when out-of-domain or OOV words are considered, and that traditional methods informed with lexicographic information would benefit from taking advantage of current NLP trends.


title: Incentives for Item Duplication under Fair Ranking Policies

abstract: Ranking is a fundamental operation in information access systems, to filter information and direct user attention towards items deemed most relevant to them. Due to position bias, items of similar relevance may receive significantly different exposure, raising fairness concerns for item providers and motivating recent research into fair ranking. While the area has progressed dramatically over recent years, no study to date has investigated the potential problem posed by duplicated items. Duplicates and near-duplicates are common in several domains, including marketplaces and document collections available to search engines. In this work, we study the behaviour of different fair ranking policies in the presence of duplicates, quantifying the extra-exposure gained by redundant items. We find that fairness-aware ranking policies may conflict with diversity, due to their potential to incentivize duplication more than policies solely focused on relevance. This fact poses a problem for system owners who, as a result of this incentive, may have to deal with increased redundancy, which is at odds with user satisfaction. Finally, we argue that this aspect represents a blind spot in the normative reasoning underlying common fair ranking metrics, as rewarding providers who duplicate their items with increased exposure seems unfair for the remaining providers.


title: Fusing ASR Outputs in Joint Training for Speech Emotion Recognition

abstract: Alongside acoustic information, linguistic features based on speech transcripts have been proven useful in Speech Emotion Recognition (SER). However, due to the scarcity of emotion labelled data and the difficulty of recognizing emotional speech, it is hard to obtain reliable linguistic features and models in this research area. In this paper, we propose to fuse Automatic Speech Recognition (ASR) outputs into the pipeline for joint training SER. The relationship between ASR and SER is understudied, and it is unclear what and how ASR features benefit SER. By examining various ASR outputs and fusion methods, our experiments show that in joint ASR-SER training, incorporating both ASR hidden and text output using a hierarchical co-attention fusion approach improves the SER performance the most. On the IEMOCAP corpus, our approach achieves 63.4% weighted accuracy, which is close to the baseline results achieved by combining ground-truth transcripts. In addition, we also present novel word error rate analysis on IEMOCAP and layer-difference analysis of the Wav2vec 2.0 model to better understand the relationship between ASR and SER.


title: Left 3-Engel Elements in Locally Finite 2-Groups

abstract: We give an infinite family of examples that generalise the construction given in arXiv:1811.12074 of a locally finite 2-group $G$ containing a left 3-Engel element $x$ where ${\langle x \rangle}^G$, the normal closure of $x$ in $G$, is not nilpotent. The construction is based on a family of Lie algebras that are of interest in their own right and make use of a classical theorem of Lucas, regarding when $\binom{m}{n}$ is even.


title: Some examples of exceptional loci in Vojta Conjecture

abstract: In this short note we discuss the exceptional locus for the Lang-Vojta's conjecture in the case of the complement of two completely reducible hyperplane sections in a cubic surface. Using elementary methods, we show that generically the exceptional set is the union of the remaining 21 lines in the surface. We also describe examples in which the exceptional set is strictly larger.


title: Reducing the Human Factor in Virtual Reality Research to Increase Reproducibility and Replicability

abstract: The replication crisis is real, and awareness of its existence is growing across disciplines. We argue that research in human-computer interaction (HCI), and especially virtual reality (VR), is vulnerable to similar challenges due to many shared methodologies, theories, and incentive structures. For this reason, in this work, we transfer established solutions from other fields to address the lack of replicability and reproducibility in HCI and VR. We focus on reducing errors resulting from the so-called human factor and adapt established solutions to the specific needs of VR research. In addition, we present a toolkit to support the setup, execution, and evaluation of VR research. Some of the features aim to reduce human errors and thus improve replicability and reproducibility. Finally, the identified chances are applied to a typical scientific process in VR.


title: Variational Bayesian Optimistic Sampling

abstract: We consider online sequential decision problems where an agent must balance exploration and exploitation. We derive a set of Bayesian `optimistic' policies which, in the stochastic multi-armed bandit case, includes the Thompson sampling policy. We provide a new analysis showing that any algorithm producing policies in the optimistic set enjoys $\tilde O(\sqrt{AT})$ Bayesian regret for a problem with $A$ actions after $T$ rounds. We extend the regret analysis for optimistic policies to bilinear saddle-point problems which include zero-sum matrix games and constrained bandits as special cases. In this case we show that Thompson sampling can produce policies outside of the optimistic set and suffer linear regret in some instances. Finding a policy inside the optimistic set amounts to solving a convex optimization problem and we call the resulting algorithm `variational Bayesian optimistic sampling' (VBOS). The procedure works for any posteriors, \ie, it does not require the posterior to have any special properties, such as log-concavity, unimodality, or smoothness. The variational view of the problem has many useful properties, including the ability to tune the exploration-exploitation tradeoff, add regularization, incorporate constraints, and linearly parameterize the policy.


title: Viscoelasticity and cell swirling motion

abstract: Although collective cell migration (CCM) is a highly coordinated and fine-tuned migratory mode, instabilities in the form of cell swirling motion (CSM) often occur. The CSM represents a product of the active turbulence obtained at low Reynolds number which has a feedback impact to various processes such as morphogenesis, wound healing, and cancer invasion. The cause of this phenomenon is related to the viscoelasticity of multicellular systems in the context of cell residual stress accumulation. Particular interest of this work is to: (1) emphasize the roles of cell shear and normal residual stress accumulated during CCM in the appearance of CSM and (2) consider the dynamics of CSM from the standpoint of rheology. Inhomogeneous distribution of the cell residual stress leads to a generation the viscoelastic force which acts to suppress CCM and can induces the system rapid stiffening. This force together with the surface tension force and traction force is responsible for the appearance of the CSM. In this work, a review of existing literature about viscoelasticity caused by CCM is given along with assortment of published experimental findings, in order to invite experimentalists to test given theoretical considerations in multicellular systems.


title: Twisted electron impact single ionization coincidence cross-sections for noble gas atoms

abstract: We present the angular profiles of the triple differential cross-section (TDCS) for the (e,2e) process on the noble gas atoms, namely He (1s), Ne (2s and 2p), and Ar (3p) for the plane wave and the twisted electron impact. We develop the theoretical formalism in the first-born approximation. The present study compares the TDCS for different values of orbital angular momentum number $m$ and opening angles $\theta_p$ of the twisted electron beam with that of the plane wave beam. In addition, we also investigate the TDCS for macroscopic atomic targets to explore the influence of opening angle $\theta_p$ of the twisted electron beam on the TDCS. Our results show that the peaks in binary and recoil region shift from the momentum transfer direction. The results also show that for larger opening angles the peaks for $p$-type orbitals split into double-peak structures which are not observed in the plane wave results for the given kinematics. The angular profiles for averaged cross-section show the dependence of TDCS on the opening angles which are significantly different from the plane wave TDCS.


title: Measurement of Compton scattering at MAMI for the extraction of the electric and magnetic polarizabilities of the proton

abstract: A precise measurement of the differential cross-sections $d\sigma/d\Omega$ and the linearly polarized photon beam asymmetry $\Sigma_3$ for Compton scattering on the proton below pion threshold has been performed with a tagged photon beam and almost $4\pi$ detector at the Mainz Microtron. The incident photons were produced by the recently upgraded Glasgow-Mainz photon tagging facility and impinged on a cryogenic liquid hydrogen target, with the scattered photons detected in the Crystal Ball/TAPS set-up. Using the highest statistics Compton scattering data ever measured on the proton along with two effective field theories (both covariant baryon and heavy-baryon) and one fixed-$t$ dispersion relation model, constraining the fits with the Baldin sum rule, we have obtained the proton electric and magnetic polarizabilities with unprecedented precision: \begin{align*} &{}\alpha_{E1} = 10.99 \pm 0.16 \pm 0.47 \pm 0.17 \pm 0.34 &{}\beta_{M1} = 3.14 \pm 0.21 \pm 0.24 \pm 0.20 \pm 0.35 \end{align*} in units of $10^{-4}$\,fm$^3$ where the errors are statistical, systematic, spin polarizability dependent and model dependent.


title: HEJ 2.1: High-energy Resummation with Vector Bosons and Next-to-Leading Logarithms

abstract: We present version 2.1 of the High Energy Jets (HEJ) event generator for hadron colliders. HEJ is a Monte Carlo generator for processes at high energies with multiple well-separated jets in the final state. To achieve accurate predictions, conventional fixed-order perturbative QCD is supplemented with an all-order resummation of large high-energy logarithms. The new version 2.1 now supports processes with final-state leptons originating from a charged or neutral vector boson together with multiple jets, in addition to processes available in earlier versions. Furthermore, the all-order resummation is extended to include an additional gauge-invariant class of subdominant logarithmic corrections. HEJ 2.1 can be obtained from https://hej.hepforge.org.


title: Shortest Beer Path Queries in Outerplanar Graphs

abstract: A \emph{beer graph} is an undirected graph $G$, in which each edge has a positive weight and some vertices have a beer store. A \emph{beer path} between two vertices $u$ and $v$ in $G$ is any path in $G$ between $u$ and $v$ that visits at least one beer store. We show that any outerplanar beer graph $G$ with $n$ vertices can be preprocessed in $O(n)$ time into a data structure of size $O(n)$, such that for any two query vertices $u$ and $v$, (i) the weight of the shortest beer path between $u$ and $v$ can be reported in $O(\alpha(n))$ time (where $\alpha(n)$ is the inverse Ackermann function), and (ii) the shortest beer path between $u$ and $v$ can be reported in $O(L)$ time, where $L$ is the number of vertices on this path. Both results are optimal, even when $G$ is a beer tree (i.e., a beer graph whose underlying graph is a tree).


title: Random Differential Topology

abstract: This manuscript collects three independent works: arXiv:1902.03805, arXiv:1906.04444, with Antonio Lerario and arXiv:2103.10853, together with some additional results, observations, examples and comments, some of which were taken up in the subsequent work arxiv:2010.14553 (with Antonio Lerario). The topic discussed in this thesis are at the crossroad of Differential Topology and Random Geometry. The common thread of these works is the study of topological and geometric properties of random smooth maps. The first chapter contains the motivations and the main results of the thesis. In particular it describes how these works are related as parts of a general method to study topological properties of smooth random maps. In the second chapter a general framework to deal with issues of differential geometric and topological nature regarding smooth Gaussian Random Fields is developed. The main results in this context are: a characterization of the convergence in law in terms of the covariance functions and a probabilistic version of Thom's jet transversality theorem. The third chapter is devoted to a generalization of the famous Kac-Rice formula. The formula presented here calculates the expected number of points at which a smooth random map meets a given (deterministic) submanifold of the codomain, whereas the standard formula deals with preimages of a point. In the fourth chapter all the previous methods are applied to Kostlan random polynomials. The fifth and last chapter of the thesis is devoted to present and prove an original theorem of Differential Topology. It says that the Betti numbers of the solution of a system of regular equations cannot decrease under a $\mathcal{C}^0$-small perturbation of the equations.


title: A Protocol for Emotions

abstract: We tend to consider emotions a manifestation of our innermost nature of human beings. Emotions characterize our lives in many ways and they chaperon every rational activity we carry out. Despite their pervasiveness, there are still many things we ignore about emotions. Among them, our understanding of how living beings transfer emotions is limited. In particular, there are highly sophisticated interactions between human beings that we would like to comprehend. For instance, think of a movie director who knows in advance the strong emotional impact that a certain scene will have on the spectators. Although many artists rely on some emotional devices, their talent and vision are still the key factors. In this work we analyze high-level protocols for transferring emotions between two intelligent agents. To the best of our knowledge, this is the first attempt to use communication protocols for modeling the exchange of human emotions. By means of a number of examples, we show that our protocols adequately model the engagement of the two parties. Beyond the theoretical interest, our proposal can provide a stepping stone for several applications that we also discuss in this paper.


title: On equivariant class formulas for t-modules

abstract: We obtain an equivariant class formula for z-deformation of t-modules. Under mild conditions, it allows us to get an equivariant class formula for t-modules.


title: Mumford-Shah regularization in electrical impedance tomography with complete electrode model

abstract: In electrical impedance tomography, we aim to solve the conductivity within a target body through electrical measurements made on the surface of the target. This inverse conductivity problem is severely ill-posed, especially in real applications with only partial boundary data available. Thus regularization has to be introduced. Conventionally regularization promoting smooth features is used, however, the Mumford--Shah regularizer familiar for image segmentation is more appropriate for targets consisting of several distinct objects or materials. It is, however, numerically challenging. We show theoretically through $\Gamma$-convergence that a modification of the Ambrosio--Tortorelli approximation of the Mumford--Shah regularizer is applicable to electrical impedance tomography, in particular the complete electrode model of boundary measurements. With numerical and experimental studies, we confirm that this functional works in practice and produces higher quality results than typical regularizations employed in electrical impedance tomography when the conductivity of the target consists of distinct smoothly-varying regions.


title: Neutrino Masses and Hubble Tension via a Majoron in MFV

abstract: The recent tension between local and early measurements of the Hubble constant can be explained in a particle physics context. A mechanism is presented where this tension is alleviated due to the presence of a Majoron, arising from the spontaneous breaking of Lepton Number. The lightness of the active neutrinos is consistently explained. Moreover, this mechanism is shown to be embeddable in the Minimal (Lepton) Flavour Violating context, providing a correct description of fermion masses and mixings, and protecting the flavour sector from large deviations from the Standard Model predictions. A QCD axion is also present to solve the Strong CP problem. The Lepton Number and the Peccei-Quinn symmetries naturally arise in the Minimal (Lepton) Flavour Violating setup and their spontaneous breaking is due to the presence of two extra scalar singlets. The Majoron phenomenology is also studied in detail. Decays of the heavy neutrinos and the invisible Higgs decay provide the strongest constraints in the model parameter space.


title: Necessary conditions on effective quantum entanglement catalysts

abstract: Quantum catalytic transformations play important roles in the transformation of quantum entangled states under local operations and classical communications (LOCC). The key problems in catalytic transformations are the existence and the bounds on the catalytic states. We present the necessary conditions of catalytic states based on a set of points given by the Schmidt coefficients of the entangled source and target states. The lower bounds on the dimensions of the catalytic states are also investigated. Moreover, we give a detailed protocol of quantum mixed state transformation under entanglement-assisted LOCC.


title: Boosting Anomaly Detection Using Unsupervised Diverse Test-Time Augmentation

abstract: Anomaly detection is a well-known task that involves the identification of abnormal events that occur relatively infrequently. Methods for improving anomaly detection performance have been widely studied. However, no studies utilizing test-time augmentation (TTA) for anomaly detection in tabular data have been performed. TTA involves aggregating the predictions of several synthetic versions of a given test sample; TTA produces different points of view for a specific test instance and might decrease its prediction bias. We propose the Test-Time Augmentation for anomaly Detection (TTAD) technique, a TTA-based method aimed at improving anomaly detection performance. TTAD augments a test instance based on its nearest neighbors; various methods, including the k-Means centroid and SMOTE methods, are used to produce the augmentations. Our technique utilizes a Siamese network to learn an advanced distance metric when retrieving a test instance's neighbors. Our experiments show that the anomaly detector that uses our TTA technique achieved significantly higher AUC results on all datasets evaluated.


title: Successor Feature Representations

abstract: Transfer in Reinforcement Learning aims to improve learning performance on target tasks using knowledge from experienced source tasks. Successor Representations (SR) and their extension Successor Features (SF) are prominent transfer mechanisms in domains where reward functions change between tasks. They reevaluate the expected return of previously learned policies in a new target task to transfer their knowledge. The SF framework extended SR by linearly decomposing rewards into successor features and a reward weight vector allowing their application in high-dimensional tasks. But this came with the cost of having a linear relationship between reward functions and successor features, limiting its application to tasks where such a linear relationship exists. We propose a novel formulation of SR based on learning the cumulative discounted probability of successor features, called Successor Feature Representations (SFR). Crucially, SFR allows to reevaluate the expected return of policies for general reward functions. We introduce different SFR variations, prove its convergence, and provide a guarantee on its transfer performance. Experimental evaluations based on SFR with function approximation demonstrate its advantage over SF not only for general reward functions, but also in the case of linearly decomposable reward functions.


title: DeF-DReL: Systematic Deployment of Serverless Functions in Fog and Cloud environments using Deep Reinforcement Learning

abstract: Fog computing is introduced by shifting cloud resources towards the users' proximity to mitigate the limitations possessed by cloud computing. Fog environment made its limited resource available to a large number of users to deploy their serverless applications, composed of several serverless functions. One of the primary intentions behind introducing the fog environment is to fulfil the demand of latency and location-sensitive serverless applications through its limited resources. The recent research mainly focuses on assigning maximum resources to such applications from the fog node and not taking full advantage of the cloud environment. This introduces a negative impact in providing the resources to a maximum number of connected users. To address this issue, in this paper, we investigated the optimum percentage of a user's request that should be fulfilled by fog and cloud. As a result, we proposed DeF-DReL, a Systematic Deployment of Serverless Functions in Fog and Cloud environments using Deep Reinforcement Learning, using several real-life parameters, such as distance and latency of the users from nearby fog node, user's priority, the priority of the serverless applications and their resource demand, etc. The performance of the DeF-DReL algorithm is further compared with recent related algorithms. From the simulation and comparison results, its superiority over other algorithms and its applicability to the real-life scenario can be clearly observed.


title: Navigating the Kaleidoscope of COVID-19 Misinformation Using Deep Learning

abstract: Irrespective of the success of the deep learning-based mixed-domain transfer learning approach for solving various Natural Language Processing tasks, it does not lend a generalizable solution for detecting misinformation from COVID-19 social media data. Due to the inherent complexity of this type of data, caused by its dynamic (context evolves rapidly), nuanced (misinformation types are often ambiguous), and diverse (skewed, fine-grained, and overlapping categories) nature, it is imperative for an effective model to capture both the local and global context of the target domain. By conducting a systematic investigation, we show that: (i) the deep Transformer-based pre-trained models, utilized via the mixed-domain transfer learning, are only good at capturing the local context, thus exhibits poor generalization, and (ii) a combination of shallow network-based domain-specific models and convolutional neural networks can efficiently extract local as well as global context directly from the target data in a hierarchical fashion, enabling it to offer a more generalizable solution.


title: Influence of ASR and Language Model on Alzheimer's Disease Detection

abstract: Alzheimer's Disease is the most common form of dementia. Automatic detection from speech could help to identify symptoms at early stages, so that preventive actions can be carried out. This research is a contribution to the ADReSSo Challenge, we analyze the usage of a SotA ASR system to transcribe participant's spoken descriptions from a picture. We analyse the loss of performance regarding the use of human transcriptions (measured using transcriptions from the 2020 ADReSS Challenge). Furthermore, we study the influence of a language model -- which tends to correct non-standard sequences of words -- with the lack of language model to decode the hypothesis from the ASR. This aims at studying the language bias and get more meaningful transcriptions based only on the acoustic information from patients. The proposed system combines acoustic -- based on prosody and voice quality -- and lexical features based on the first occurrence of the most common words. The reported results show the effect of using automatic transcripts with or without language model. The best fully automatic system achieves up to 76.06 % of accuracy (without language model), significantly higher, 3 % above, than a system employing word transcriptions decoded using general purpose language models.


title: Distilling Relation Embeddings from Pre-trained Language Models

abstract: Pre-trained language models have been found to capture a surprisingly rich amount of lexical knowledge, ranging from commonsense properties of everyday concepts to detailed factual knowledge about named entities. Among others, this makes it possible to distill high-quality word vectors from pre-trained language models. However, it is currently unclear to what extent it is possible to distill relation embeddings, i.e. vectors that characterize the relationship between two words. Such relation embeddings are appealing because they can, in principle, encode relational knowledge in a more fine-grained way than is possible with knowledge graphs. To obtain relation embeddings from a pre-trained language model, we encode word pairs using a (manually or automatically generated) prompt, and we fine-tune the language model such that relationally similar word pairs yield similar output vectors. We find that the resulting relation embeddings are highly competitive on analogy (unsupervised) and relation classification (supervised) benchmarks, even without any task-specific fine-tuning. Source code to reproduce our experimental results and the model checkpoints are available in the following repository: https://github.com/asahi417/relbert


title: Integrating Deep Event-Level and Script-Level Information for Script Event Prediction

abstract: Scripts are structured sequences of events together with the participants, which are extracted from the texts.Script event prediction aims to predict the subsequent event given the historical events in the script. Two kinds of information facilitate this task, namely, the event-level information and the script-level information. At the event level, existing studies view an event as a verb with its participants, while neglecting other useful properties, such as the state of the participants. At the script level, most existing studies only consider a single event sequence corresponding to one common protagonist. In this paper, we propose a Transformer-based model, called MCPredictor, which integrates deep event-level and script-level information for script event prediction. At the event level, MCPredictor utilizes the rich information in the text to obtain more comprehensive event semantic representations. At the script-level, it considers multiple event sequences corresponding to different participants of the subsequent event. The experimental results on the widely-used New York Times corpus demonstrate the effectiveness and superiority of the proposed model.


title: Hidden Markov Based Mathematical Model dedicated to Extract Ingredients from Recipe Text

abstract: Natural Language Processing (NLP) is a branch of artificial intelligence that gives machines the ability to decode human languages. Partof-speech tagging (POS tagging) is a pre-processing task that requires an annotated corpus. Rule-based and stochastic methods showed remarkable results for POS tag prediction. On this work, I performed a mathematical model based on Hidden Markov structures and I obtained a high-level accuracy of ingredients extracted from text recipe with performances greater than what traditional methods could make without unknown words consideration.


title: Neural sentence embedding models for semantic similarity estimation in the biomedical domain

abstract: BACKGROUND: In this study, we investigated the efficacy of current state-of-the-art neural sentence embedding models for semantic similarity estimation of sentences from biomedical literature. We trained different neural embedding models on 1.7 million articles from the PubMed Open Access dataset, and evaluated them based on a biomedical benchmark set containing 100 sentence pairs annotated by human experts and a smaller contradiction subset derived from the original benchmark set. RESULTS: With a Pearson correlation of 0.819, our best unsupervised model based on the Paragraph Vector Distributed Memory algorithm outperforms previous state-of-the-art results achieved on the BIOSSES biomedical benchmark set. Moreover, our proposed supervised model that combines different string-based similarity metrics with a neural embedding model surpasses previous ontology-dependent supervised state-of-the-art approaches in terms of Pearson's r (r=0.871) on the biomedical benchmark set. In contrast to the promising results for the original benchmark, we found our best models' performance on the smaller contradiction subset to be poor. CONCLUSIONS: In this study we highlighted the value of neural network-based models for semantic similarity estimation in the biomedical domain by showing that they can keep up with and even surpass previous state-of-the-art approaches for semantic similarity estimation that depend on the availability of laboriously curated ontologies when evaluated on a biomedical benchmark set. Capturing contradictions and negations in biomedical sentences, however, emerged as an essential area for further work.


title: LegalNLP -- Natural Language Processing methods for the Brazilian Legal Language

abstract: We present and make available pre-trained language models (Phraser, Word2Vec, Doc2Vec, FastText, and BERT) for the Brazilian legal language, a Python package with functions to facilitate their use, and a set of demonstrations/tutorials containing some applications involving them. Given that our material is built upon legal texts coming from several Brazilian courts, this initiative is extremely helpful for the Brazilian legal field, which lacks other open and specific tools and language models. Our main objective is to catalyze the use of natural language processing tools for legal texts analysis by the Brazilian industry, government, and academia, providing the necessary tools and accessible material.


title: Classification of hierarchical text using geometric deep learning: the case of clinical trials corpus

abstract: We consider the hierarchical representation of documents as graphs and use geometric deep learning to classify them into different categories. While graph neural networks can efficiently handle the variable structure of hierarchical documents using the permutation invariant message passing operations, we show that we can gain extra performance improvements using our proposed selective graph pooling operation that arises from the fact that some parts of the hierarchy are invariable across different documents. We applied our model to classify clinical trial (CT) protocols into completed and terminated categories. We use bag-of-words based, as well as pre-trained transformer-based embeddings to featurize the graph nodes, achieving f1-scores around 0.85 on a publicly available large scale CT registry of around 360K protocols. We further demonstrate how the selective pooling can add insights into the CT termination status prediction. We make the source code and dataset splits accessible.


title: Study of geometric phase using classical coupled oscillators

abstract: We illustrate the geometric phase associated with the cyclic dynamics of a classical system of coupled oscillators. We use an analogy between a classical coupled oscillator and a two-state quantum mechanical system to represent the evolution of the oscillator on an equivalent Hilbert space, which may be represented as a trajectory on the surface of a sphere. The cyclic evolution of the system leads to a change in phase, which consists of a dynamic phase along with an additional phase shift dependent on the geometry of the evolution. A simple experiment suitable for advanced undergraduate students is designed to study the geometric phase incurred during cyclic evolution of a coupled oscillator.


title: Analysing the Effect of Masking Length Distribution of MLM: An Evaluation Framework and Case Study on Chinese MRC Datasets

abstract: Machine reading comprehension (MRC) is a challenging natural language processing (NLP) task. Recently, the emergence of pre-trained models (PTM) has brought this research field into a new era, in which the training objective plays a key role. The masked language model (MLM) is a self-supervised training objective that widely used in various PTMs. With the development of training objectives, many variants of MLM have been proposed, such as whole word masking, entity masking, phrase masking, span masking, and so on. In different MLM, the length of the masked tokens is different. Similarly, in different machine reading comprehension tasks, the length of the answer is also different, and the answer is often a word, phrase, or sentence. Thus, in MRC tasks with different answer lengths, whether the length of MLM is related to performance is a question worth studying. If this hypothesis is true, it can guide us how to pre-train the MLM model with a relatively suitable mask length distribution for MRC task. In this paper, we try to uncover how much of MLM's success in the machine reading comprehension tasks comes from the correlation between masking length distribution and answer length in MRC dataset. In order to address this issue, herein, (1) we propose four MRC tasks with different answer length distributions, namely short span extraction task, long span extraction task, short multiple-choice cloze task, long multiple-choice cloze task; (2) four Chinese MRC datasets are created for these tasks; (3) we also have pre-trained four masked language models according to the answer length distributions of these datasets; (4) ablation experiments are conducted on the datasets to verify our hypothesis. The experimental results demonstrate that our hypothesis is true.


title: Nonsmooth mean field games with state constraints

abstract: In this paper, we consider a mean field game model inspired by crowd motion where agents aim to reach a closed set, called target set, in minimal time. Congestion phenomena are modeled through a constraint on the velocity of an agent that depends on the average density of agents around their position. The model is considered in the presence of state constraints: roughly speaking, these constraints may model walls, columns, fences, hedges, or other kinds of obstacles at the boundary of the domain which agents cannot cross. After providing a more detailed description of the model, the paper recalls some previous results on the existence of equilibria for such games and presents the main difficulties that arise due to the presence of state constraints. Our main contribution is to show that equilibria of the game satisfy a system of coupled partial differential equations, known mean field game system, thanks to recent techniques to characterize optimal controls in the presence of state constraints. These techniques not only allow to deal with state constraints but also require very few regularity assumptions on the dynamics of the agents.


title: Neighbourhood completeness for quantified pretransitive modal logics

abstract: We consider quantified pretransitive Horn modal logic. It is known that such logics are complete with respect to predicate Kripke frames with expanding domains. In this paper we prove that they are also complete with respect to neighbourhood frames with constant domains.


title: An Effective Image Restorer: Denoising and Luminance Adjustment for Low-photon-count Imaging

abstract: Imaging under photon-scarce situations introduces challenges to many applications as the captured images are with low signal-to-noise ratio and poor luminance. In this paper, we investigate the raw image restoration under low-photon-count conditions by simulating the imaging of quanta image sensor (QIS). We develop a lightweight framework, which consists of a multi-level pyramid denoising network (MPDNet) and a luminance adjustment (LA) module to achieve separate denoising and luminance enhancement. The main component of our framework is the multi-skip attention residual block (MARB), which integrates multi-scale feature fusion and attention mechanism for better feature representation. Our MPDNet adopts the idea of Laplacian pyramid to learn the small-scale noise map and larger-scale high-frequency details at different levels, and feature extractions are conducted on the multi-scale input images to encode richer contextual information. Our LA module enhances the luminance of the denoised image by estimating its illumination, which can better avoid color distortion. Extensive experimental results have demonstrated that our image restorer can achieve superior performance on the degraded images with various photon levels by suppressing noise and recovering luminance and color effectively.


title: Building the Language Resource for a Cebuano-Filipino Neural Machine Translation System

abstract: Parallel corpus is a critical resource in machine learning-based translation. The task of collecting, extracting, and aligning texts in order to build an acceptable corpus for doing the translation is very tedious most especially for low-resource languages. In this paper, we present the efforts made to build a parallel corpus for Cebuano and Filipino from two different domains: biblical texts and the web. For the biblical resource, subword unit translation for verbs and copy-able approach for nouns were applied to correct inconsistencies in the translation. This correction mechanism was applied as a preprocessing technique. On the other hand, for Wikipedia being the main web resource, commonly occurring topic segments were extracted from both the source and the target languages. These observed topic segments are unique in 4 different categories. The identification of these topic segments may be used for the automatic extraction of sentences. A Recurrent Neural Network was used to implement the translation using OpenNMT sequence modeling tool in TensorFlow. The two different corpora were then evaluated by using them as two separate inputs in the neural network. Results have shown a difference in BLEU scores in both corpora.


title: LIDSNet: A Lightweight on-device Intent Detection model using Deep Siamese Network

abstract: Intent detection is a crucial task in any Natural Language Understanding (NLU) system and forms the foundation of a task-oriented dialogue system. To build high-quality real-world conversational solutions for edge devices, there is a need for deploying intent detection model on device. This necessitates a light-weight, fast, and accurate model that can perform efficiently in a resource-constrained environment. To this end, we propose LIDSNet, a novel lightweight on-device intent detection model, which accurately predicts the message intent by utilizing a Deep Siamese Network for learning better sentence representations. We use character-level features to enrich the sentence-level representations and empirically demonstrate the advantage of transfer learning by utilizing pre-trained embeddings. Furthermore, to investigate the efficacy of the modules in our architecture, we conduct an ablation study and arrive at our optimal model. Experimental results prove that LIDSNet achieves state-of-the-art competitive accuracy of 98.00% and 95.97% on SNIPS and ATIS public datasets respectively, with under 0.59M parameters. We further benchmark LIDSNet against fine-tuned BERTs and show that our model is at least 41x lighter and 30x faster during inference than MobileBERT on Samsung Galaxy S20 device, justifying its efficiency on resource-constrained edge devices.


title: Deep convolutional forest: a dynamic deep ensemble approach for spam detection in text

abstract: The increase in people's use of mobile messaging services has led to the spread of social engineering attacks like phishing, considering that spam text is one of the main factors in the dissemination of phishing attacks to steal sensitive data such as credit cards and passwords. In addition, rumors and incorrect medical information regarding the COVID-19 pandemic are widely shared on social media leading to people's fear and confusion. Thus, filtering spam content is vital to reduce risks and threats. Previous studies relied on machine learning and deep learning approaches for spam classification, but these approaches have two limitations. Machine learning models require manual feature engineering, whereas deep neural networks require a high computational cost. This paper introduces a dynamic deep ensemble model for spam detection that adjusts its complexity and extracts features automatically. The proposed model utilizes convolutional and pooling layers for feature extraction along with base classifiers such as random forests and extremely randomized trees for classifying texts into spam or legitimate ones. Moreover, the model employs ensemble learning procedures like boosting and bagging. As a result, the model achieved high precision, recall, f1-score and accuracy of 98.38\%.


title: Generational Frameshifts in Technology: Computer Science and Neurosurgery, The VR Use Case

abstract: We are at a unique moment in history where there is a confluence of technologies which will synergistically come together to transform the practice of neurosurgery. These technological transformations will be all-encompassing, including improved tools and methods for intraoperative performance of neurosurgery, scalable solutions for asynchronous neurosurgical training and simulation, as well as broad aggregation of operative data allowing fundamental changes in quality assessment, billing, outcome measures, and dissemination of surgical best practices. The ability to perform surgery more safely and more efficiently while capturing the operative details and parsing each component of the operation will open an entirely new epoch advancing our field and all surgical specialties. The digitization of all components within the operating room will allow us to leverage the various fields within computer and computational science to obtain new insights that will improve care and delivery of the highest quality neurosurgery regardless of location. The democratization of neurosurgery is at hand and will be driven by our development, extraction, and adoption of these tools of the modern world. Virtual reality provides a good example of how consumer-facing technologies are finding a clear role in industry and medicine and serves as a notable example of the confluence of various computer science technologies creating a novel paradigm for scaling human ability and interactions. The authors describe the technology ecosystem that has come and highlight a myriad of computational and data sciences that will be necessary to enable the operating room of the near future.


title: Weakly Supervised Concept Map Generation through Task-Guided Graph Translation

abstract: Recent years have witnessed the rapid development of concept map generation techniques due to their advantages in providing well-structured summarization of knowledge from free texts. Traditional unsupervised methods do not generate task-oriented concept maps, whereas deep generative models require large amounts of training data. In this work, we present GT-D2G (Graph Translation-based Document To Graph), an automatic concept map generation framework that leverages generalized NLP pipelines to derive semantic-rich initial graphs, and translates them into more concise structures under the weak supervision of downstream task labels. The concept maps generated by GT-D2G can provide interpretable summarization of structured knowledge for the input texts, which are demonstrated through human evaluation and case studies on three real-world corpora. Further experiments on the downstream task of document classification show that GT-D2G beats other concept map generation methods. Moreover, we specifically validate the labeling efficiency of GT-D2G in the label-efficient learning setting and the flexibility of generated graph sizes in controlled hyper-parameter studies.


title: Paperswithtopic: Topic Identification from Paper Title Only

abstract: The deep learning field is growing rapidly as witnessed by the exponential growth of papers submitted to journals, conferences, and pre-print servers. To cope with the sheer number of papers, several text mining tools from natural language processing (NLP) have been proposed that enable researchers to keep track of recent findings. In this context, our paper makes two main contributions: first, we collected and annotated a dataset of papers paired by title and sub-field from the field of artificial intelligence (AI), and, second, we present results on how to predict a paper's AI sub-field from a given paper title only. Importantly, for the latter, short-text classification task we compare several algorithms from conventional machine learning all the way up to recent, larger transformer architectures. Finally, for the transformer models, we also present gradient-based, attention visualizations to further explain the model's classification process. All code can be found at \url{https://github.com/1pha/paperswithtopic}


title: ICDM 2020 Knowledge Graph Contest: Consumer Event-Cause Extraction

abstract: Consumer Event-Cause Extraction, the task aimed at extracting the potential causes behind certain events in the text, has gained much attention in recent years due to its wide applications. The ICDM 2020 conference sets up an evaluation competition that aims to extract events and the causes of the extracted events with a specified subject (a brand or product). In this task, we mainly focus on how to construct an end-to-end model, and extract multiple event types and event-causes simultaneously. To this end, we introduce a fresh perspective to revisit the relational event-cause extraction task and propose a novel sequence tagging framework, instead of extracting event types and events-causes separately. Experiments show our framework outperforms baseline methods even when its encoder module uses an initialized pre-trained BERT encoder, showing the power of the new tagging framework. In this competition, our team achieved 1st place in the first stage leaderboard, and 3rd place in the final stage leaderboard.


title: SP-GPT2: Semantics Improvement in Vietnamese Poetry Generation

abstract: Automatic text generation has garnered growing attention in recent years as an essential step towards computer creativity. Generative Pretraining Transformer 2 (GPT2) is one of the state of the art approaches that have excellent successes. In this paper, we took the first step to investigate the power of GPT2 in traditional Vietnamese poetry generation. In the earlier time, our experiment with base GPT2 was quite good at generating the poem in the proper template. Though it can learn the patterns, including rhyme and tone rules, from the training data, like almost all other text generation approaches, the poems generated still has a topic drift and semantic inconsistency. To improve the cohesion within the poems, we proposed a new model SP-GPT2 (semantic poem GPT2) which was built on the top GPT2 model and an additional loss to constrain context throughout the entire poem. For better evaluation, we examined the methods by both automatic quantitative evaluation and human evaluation. Both automatic and human evaluation demonstrated that our approach can generate poems that have better cohesion without losing the quality due to additional loss. At the same time, we are the pioneers of this topic. We released the first computational scoring module for poems generated in the template containing the style rule dictionary. Additionally, we are the first to publish a Luc-Bat dataset, including 87609 Luc Bat poems, which is equivalent to about 2.6 million sentences, combined with about 83579 poems in other styles was also published for further exploration. The code is available at https://github.com/fsoft-ailab/Poem-Generator


title: Learning to Learn End-to-End Goal-Oriented Dialog From Related Dialog Tasks

abstract: For each goal-oriented dialog task of interest, large amounts of data need to be collected for end-to-end learning of a neural dialog system. Collecting that data is a costly and time-consuming process. Instead, we show that we can use only a small amount of data, supplemented with data from a related dialog task. Naively learning from related data fails to improve performance as the related data can be inconsistent with the target task. We describe a meta-learning based method that selectively learns from the related dialog task data. Our approach leads to significant accuracy improvements in an example dialog task.


title: Batch-Softmax Contrastive Loss for Pairwise Sentence Scoring Tasks

abstract: The use of contrastive loss for representation learning has become prominent in computer vision, and it is now getting attention in Natural Language Processing (NLP). Here, we explore the idea of using a batch-softmax contrastive loss when fine-tuning large-scale pre-trained transformer models to learn better task-specific sentence embeddings for pairwise sentence scoring tasks. We introduce and study a number of variations in the calculation of the loss as well as in the overall training procedure; in particular, we find that data shuffling can be quite important. Our experimental results show sizable improvements on a number of datasets and pairwise sentence scoring tasks including classification, ranking, and regression. Finally, we offer detailed analysis and discussion, which should be useful for researchers aiming to explore the utility of contrastive loss in NLP.


title: Social Media Reveals Urban-Rural Differences in Stress across China

abstract: Modeling differential stress expressions in urban and rural regions in China can provide a better understanding of the effects of urbanization on psychological well-being in a country that has rapidly grown economically in the last two decades. This paper studies linguistic differences in the experiences and expressions of stress in urban-rural China from Weibo posts from over 65,000 users across 329 counties using hierarchical mixed-effects models. We analyzed phrases, topical themes, and psycho-linguistic word choices in Weibo posts mentioning stress to better understand appraisal differences surrounding psychological stress in urban and rural communities in China; we then compared them with large-scale polls from Gallup. After controlling for socioeconomic and gender differences, we found that rural communities tend to express stress in emotional and personal themes such as relationships, health, and opportunity while users in urban areas express stress using relative, temporal, and external themes such as work, politics, and economics. These differences exist beyond controlling for GDP and urbanization, indicating a fundamentally different lifestyle between rural and urban residents in very specific environments, arguably having different sources of stress. We found corroborative trends in physical, financial, and social wellness with urbanization in Gallup polls.


title: Calling to CNN-LSTM for Rumor Detection: A Deep Multi-channel Model for Message Veracity Classification in Microblogs

abstract: Reputed by their low-cost, easy-access, real-time and valuable information, social media also wildly spread unverified or fake news. Rumors can notably cause severe damage on individuals and the society. Therefore, rumor detection on social media has recently attracted tremendous attention. Most rumor detection approaches focus on rumor feature analysis and social features, i.e., metadata in social media. Unfortunately, these features are data-specific and may not always be available, e.g., when the rumor has just popped up and not yet propagated. In contrast, post contents (including images or videos) play an important role and can indicate the diffusion purpose of a rumor. Furthermore, rumor classification is also closely related to opinion mining and sentiment analysis. Yet, to the best of our knowledge, exploiting images and sentiments is little investigated.Considering the available multimodal features from microblogs, notably, we propose in this paper an end-to-end model called deepMONITOR that is based on deep neural networks and allows quite accurate automated rumor verification, by utilizing all three characteristics: post textual and image contents, as well as sentiment. deepMONITOR concatenates image features with the joint text and sentiment features to produce a reliable, fused classification. We conduct extensive experiments on two large-scale, real-world datasets. The results show that deepMONITOR achieves a higher accuracy than state-of-the-art methods.


title: Deep Learning for Bias Detection: From Inception to Deployment

abstract: To create a more inclusive workplace, enterprises are actively investing in identifying and eliminating unconscious bias (e.g., gender, race, age, disability, elitism and religion) across their various functions. We propose a deep learning model with a transfer learning based language model to learn from manually tagged documents for automatically identifying bias in enterprise content. We first pretrain a deep learning-based language-model using Wikipedia, then fine tune the model with a large unlabelled data set related with various types of enterprise content. Finally, a linear layer followed by softmax layer is added at the end of the language model and the model is trained on a labelled bias dataset consisting of enterprise content. The trained model is thoroughly evaluated on independent datasets to ensure a general application. We present the proposed method and its deployment detail in a real-world application.


title: Decision Attentive Regularization to Improve Simultaneous Speech Translation Systems

abstract: Simultaneous translation systems start producing the output while processing the partial source sentence in the incoming input stream. These systems need to decide when to read more input and when to write the output. These decisions depend on the structure of source/target language and the information contained in the partial input sequence. Hence, read/write decision policy remains the same across different input modalities, i.e., speech and text. This motivates us to leverage the text transcripts corresponding to the speech input for improving simultaneous speech-to-text translation (SimulST). We propose Decision Attentive Regularization (DAR) to improve the decision policy of SimulST systems by using the simultaneous text-to-text translation (SimulMT) task. We also extend several techniques from the offline speech translation domain to explore the role of SimulMT task in improving SimulST performance. Overall, we achieve 34.66% / 4.5 BLEU improvement over the baseline model across different latency regimes for the MuST-C English-German (EnDe) SimulST task.


title: E-Commerce Dispute Resolution Prediction

abstract: E-Commerce marketplaces support millions of daily transactions, and some disagreements between buyers and sellers are unavoidable. Resolving disputes in an accurate, fast, and fair manner is of great importance for maintaining a trustworthy platform. Simple cases can be automated, but intricate cases are not sufficiently addressed by hard-coded rules, and therefore most disputes are currently resolved by people. In this work we take a first step towards automatically assisting human agents in dispute resolution at scale. We construct a large dataset of disputes from the eBay online marketplace, and identify several interesting behavioral and linguistic patterns. We then train classifiers to predict dispute outcomes with high accuracy. We explore the model and the dataset, reporting interesting correlations, important features, and insights.


title: CORAA: a large corpus of spontaneous and prepared speech manually validated for speech recognition in Brazilian Portuguese

abstract: Automatic Speech recognition (ASR) is a complex and challenging task. In recent years, there have been significant advances in the area. In particular, for the Brazilian Portuguese (BP) language, there were about 376 hours public available for ASR task until the second half of 2020. With the release of new datasets in early 2021, this number increased to 574 hours. The existing resources, however, are composed of audios containing only read and prepared speech. There is a lack of datasets including spontaneous speech, which are essential in different ASR applications. This paper presents CORAA (Corpus of Annotated Audios) v1. with 290.77 hours, a publicly available dataset for ASR in BP containing validated pairs (audio-transcription). CORAA also contains European Portuguese audios (4.69 hours). We also present a public ASR model based on Wav2Vec 2.0 XLSR-53 and fine-tuned over CORAA. Our model achieved a Word Error Rate of 24.18% on CORAA test set and 20.08% on Common Voice test set. When measuring the Character Error Rate, we obtained 11.02% and 6.34% for CORAA and Common Voice, respectively. CORAA corpora were assembled to both improve ASR models in BP with phenomena from spontaneous speech and motivate young researchers to start their studies on ASR for Portuguese. All the corpora are publicly available at https://github.com/nilc-nlp/CORAA under the CC BY-NC-ND 4.0 license.


title: Named Entity Recognition in Unstructured Medical Text Documents

abstract: Physicians provide expert opinion to legal courts on the medical state of patients, including determining if a patient is likely to have permanent or non-permanent injuries or ailments. An independent medical examination (IME) report summarizes a physicians medical opinion about a patients health status based on the physicians expertise. IME reports contain private and sensitive information (Personally Identifiable Information or PII) that needs to be removed or randomly encoded before further research work can be conducted. In our study the IME is an orthopedic surgeon from a private practice in the United States. The goal of this research is to perform named entity recognition (NER) to identify and subsequently remove/encode PII information from IME reports prepared by the physician. We apply the NER toolkits of OpenNLP and spaCy, two freely available natural language processing platforms, and compare their precision, recall, and f-measure performance at identifying five categories of PII across trials of randomly selected IME reports using each models common default parameters. We find that both platforms achieve high performance (f-measure > 0.9) at de-identification and that a spaCy model trained with a 70-30 train-test data split is most performant.


title: Detecting Gender Bias in Transformer-based Models: A Case Study on BERT

abstract: In this paper, we propose a novel gender bias detection method by utilizing attention map for transformer-based models. We 1) give an intuitive gender bias judgement method by comparing the different relation degree between the genders and the occupation according to the attention scores, 2) design a gender bias detector by modifying the attention module, 3) insert the gender bias detector into different positions of the model to present the internal gender bias flow, and 4) draw the consistent gender bias conclusion by scanning the entire Wikipedia, a BERT pretraining dataset. We observe that 1) the attention matrices, Wq and Wk introduce much more gender bias than other modules (including the embedding layer) and 2) the bias degree changes periodically inside of the model (attention matrix Q, K, V, and the remaining part of the attention layer (including the fully-connected layer, the residual connection, and the layer normalization module) enhance the gender bias while the averaged attentions reduces the bias).


title: The extended Smale's 9th problem -- On computational barriers and paradoxes in estimation, regularisation, computer-assisted proofs and learning

abstract: Linear and semidefinite programming (LP, SDP), regularisation through basis pursuit (BP) and Lasso have seen great success in mathematics, statistics, data science, computer-assisted proofs and learning. The success of LP is traditionally attributed to the fact that it is "in P" for rational inputs. On the other hand, in his list of problems for the 21st century S. Smale calls for "[Computational] models which process approximate inputs and which permit round-off computations". Indeed, since e.g. the exponential function does not have an exact representation or floating-point arithmetic approximates every rational number that is not in base-2, inexact input is a daily encounter. The model allowing inaccurate input of arbitrary precision, which we call the extended model, leads to extended versions of fundamental problems such as: "Are LP and other aforementioned problems in P?" The same question can be asked for an extended version of Smale's 9th problem on the list of mathematical problems for the 21st century: "Is there a polynomial time algorithm over the real numbers which decides the feasibility of the linear system of inequalities, and if so, outputs a feasible candidate?" One can thus pose this problem in the extended model. Similarly, the optimisation problems BP, SDP and Lasso, where the task is to output a solution to a specified precision, can likewise be posed in the extended model, also considering randomised algorithms. We will collectively refer to these problems as the extended Smale's 9th problem, which we settle in both the negative and the positive yielding two surprises: (1) In mathematics, sparse regularisation, statistics, and learning, one successfully computes with non-computable functions. (2) In order to mathematically characterise this phenomenon, one needs an intricate complexity theory for, seemingly paradoxically, non-computable functions.


title: Dimension-free $L^p$ estimates for vectors of Riesz transforms in the rational Dunkl setting

abstract: In this article, we prove dimension-free upper bound for the $L^p$-norms of the vector of Riesz transforms in the rational Dunkl setting. Our main technique is Bellman function method adapted to the Dunkl setting.


title: Prime Spectrum of the Ring of Adeles of a Number Field

abstract: Much is known about the adele ring of an algebraic number field from the perspective of Harmonic Analysis and Class Field Theory. However, its ring-theoretical aspects are often ignored. Here we present a description of the prime spectrum of this ring and study some of the algebraic and topological properties of these prime ideals. We also study how they behave under separable extensions of the base field and give an indication of how this study can be applied in adele rings not of number fields.


title: Multi-reference many-body perturbation theory for nuclei I -- Novel PGCM-PT formalism

abstract: Perturbative and non-perturbative expansion methods already constitute a tool of choice to perform ab initio calculations over a significant part of the nuclear chart. In this context, the categories of accessible nuclei directly reflect the class of unperturbed state employed in the formulation of the expansion. The present work generalizes to the nuclear many-body context the versatile method of Ref. \cite{burton20a} by formulating a perturbative expansion on top of a multi-reference unperturbed state mixing deformed non-orthogonal Bogoliubov vacua, i.e. a state obtained from the projected generator coordinate method (PGCM). Particular attention is paid to the part of the mixing taking care of the symmetry restoration, showing that it can be exactly contracted throughout the expansion, thus reducing significantly the dimensionality of the linear problem to be solved to extract perturbative corrections. While the novel expansion method, coined as PGCM-PT, reduces to the PGCM at lowest order, it reduces to single-reference perturbation theories in appropriate limits. Based on a PGCM unperturbed state capturing (strong) static correlations in a versatile and efficient fashion, PGCM-PT is indistinctly applicable to doubly closed-shell, singly open-shell and doubly open-shell nuclei. The remaining (weak) dynamical correlations are brought consistently through perturbative corrections. This symmetry-conserving multi-reference perturbation theory is state-specific and applies to both ground and excited PGCM unperturbed states, thus correcting each state belonging to the low-lying spectrum of the system under study.


title: Subespacios densos de $C[0,1]$. Teoremas de Stone-Weierstrass y de M\"untz-Sz\'asz

abstract: In this work, we look into some results about dense subspaces of $C[0,1]$. Being our starting point the Weierstrass' Approximation Theorem, we study generalization of this in two directions: the first one studying subspaces which also have algebra structure, where the main result will be the Stone-Weierstrass theorem, and the second one will be considering subspaces generated by sets of monomials whose exponents satisfy certain properties, where the central result will be the M\"untz-Sz\'asz theorem. Finally, we gather some of the most recent advances from this topic.


title: Scalable Inference in SDEs by Direct Matching of the Fokker-Planck-Kolmogorov Equation

abstract: Simulation-based techniques such as variants of stochastic Runge-Kutta are the de facto approach for inference with stochastic differential equations (SDEs) in machine learning. These methods are general-purpose and used with parametric and non-parametric models, and neural SDEs. Stochastic Runge-Kutta relies on the use of sampling schemes that can be inefficient in high dimensions. We address this issue by revisiting the classical SDE literature and derive direct approximations to the (typically intractable) Fokker-Planck-Kolmogorov equation by matching moments. We show how this workflow is fast, scales to high-dimensional latent spaces, and is applicable to scarce-data applications, where a non-parametric SDE with a driving Gaussian process velocity field specifies the model.


title: Identification and prioritization of urban traffic bottlenecks

abstract: The increasing urbanization process we have been witnessing in the last decades is accompanied by a significant increase in traffic congestion in cities around the world. The effect of the congestion is represented in the enormous time people spent on roads leading to significant money waste and air pollution. Here, we present a new methodology for identification, cost evaluation, and thus, prioritization of congestion sources, the jam bottlenecks. It extends existing methods as it is based on network analysis of the entire road network and can be applied to different traffic models. Our results show that the macro-stability, presented by scaling characteristics of the traffic bottlenecks, overshadows the existence of meso-dynamics, where the bottlenecks change their location in time and space. This means that to plan and manage traffic jams in different locations and at different times, it is required to implement a framework, as developed here, that tracks traffic and evaluates the relative effect of each evolving bottleneck on the entire road network.


title: On new parameters concerning a generalization of the parallelogram law in Banach spaces

abstract: We shall introduce a new geometric constant $L^{\prime}_{\mathrm{Y}}(\lambda,X)$ based on a generalization of the parallelogram law. We first investigate some basic properties of this new coefficient. Next, it is shown that, for a Banach space, $L^{\prime}_{\mathrm{Y}}(\lambda,X)$ becomes $1$ for some $\lambda_0\in (0,1)$ if and only if the norm is induced by an inner product. Moreover, some relations between other well-known geometric constants are studied. Finally, a sufficient condition which implies normal structure is presented.


title: Barlow Graph Auto-Encoder for Unsupervised Network Embedding

abstract: Network embedding has emerged as a promising research field for network analysis. Recently, an approach, named Barlow Twins, has been proposed for self-supervised learning in computer vision by applying the redundancy-reduction principle to the embedding vectors corresponding to two distorted versions of the image samples. Motivated by this, we propose Barlow Graph Auto-Encoder, a simple yet effective architecture for learning network embedding. It aims to maximize the similarity between the embedding vectors of immediate and larger neighborhoods of a node, while minimizing the redundancy between the components of these projections. In addition, we also present the variation counterpart named as Barlow Variational Graph Auto-Encoder. Our approach yields promising results for inductive link prediction and is also on par with state of the art for clustering and downstream node classification, as demonstrated by extensive comparisons with several well-known techniques on three benchmark citation datasets.


title: Normalized characters of symmetric groups and Boolean cumulants via Khovanov's Heisenberg category

abstract: In this paper, we study relationships between the normalized characters of symmetric groups and the Boolean cumulants of Young diagrams. Specifically, we show that each normalized character is a polynomial of twisted Boolean cumulants with coefficients being non-negative integers, and conversely, that, when we expand a Boolean cumulant in terms of normalized characters, the coefficients are again non-negative integers. The main tool is Khovanov's Heisenberg category and the recently established connection of its center to the ring of functions on Young diagrams, which enables one to apply graphical manipulations to the computation of functions on Young diagrams. Therefore, this paper is an attempt to deepen the connection between the asymptotic representation theory and graphical categorification.


title: Media Modulation in Molecular Communications

abstract: In conventional molecular communication (MC) systems, the signaling molecules used for information transmission are stored, released, and then replenished by a transmitter (TX). However, the replenishment of signaling molecules at the TX is challenging in practice. Furthermore, in most envisioned MC applications, e.g., in the medical field, it is not desirable to insert the TX into the MC system, as this might impair natural biological processes. In this paper, we propose the concept of media modulation based MC where the TX is placed outside the channel and utilizes signaling molecules already existing inside the system. We consider signaling molecules that can be in different states which can be switched by external stimuli. Hence, in media modulation based MC, for information transmission, the TX stimulates the signaling molecules to encode information into their state. In particular, we elaborate media modulation for the group of photochromic molecules, which undergo light-induced reversible transformations, and study the usage of these molecules for information transmission in a three-dimensional duct system. We develop a statistical model for the received signal which depends on the distribution of the signaling molecules in the system, the reliability of the state control mechanism, and the randomness of molecule propagation. Furthermore, we analyze the performance of media modulation based MC in terms of the bit error rate (BER). We show that media modulation enables reliable information transmission, which renders a TX inside the channel unnecessary.


title: Exploring jet fragmentation using two-particle correlations with $\Lambda$ and K$^0_{\rm S}$

abstract: Complementary to jet reconstruction, two-particle correlations in $\Delta\eta$ and $\Delta\varphi$ are used to study jets, in particular their particle composition. While in Pb--Pb collisions this is done to characterize the quark--gluon plasma, pp and p--Pb collisions serve as a reference and are of interest on their own for their input into the understanding of particle production mechanisms. Recent ALICE results on the production of strange particles in small systems (pp and p--Pb collisions) reveal the possibility of having similar strange hadron production mechanisms in all collision systems. We present here a study of two-particle correlations triggered with strange hadrons ($\mathrm{K_S^0}$, $\Lambda$, $\overline{\Lambda}$) in pp collisions at 13 TeV and 5.02 TeV and in the most central Pb--Pb collisions at $\sqrt{s_{\mathrm{NN}}}$= 5.02 TeV. The dependence of the per-trigger yields of primary charged hadrons on the transverse momenta of the trigger and associated particles, as well as on the event multiplicity, will be presented for both the near-side and away-side regions. Moreover, the ratios of these yields to the yields extracted from inclusive hadron-hadron correlations and the nuclear modification factor $I_{AA}$ will be discussed. The results are compared among the three hadron species. In addition, a comparison to different Monte Carlo generators is presented, which allows us to better understand strangeness production in jets.


title: Optical spectroscopy and ultrafast pump-probe study of structural phase transition in 1T'-TaTe2

abstract: 1T'-TaTe2 exhibits an intriguing first-order structural phase transition at around 170 K. Understanding the electronic structural properties is a crucial way to comprehend the origin of the structural phase transition. We performed a combined optical and ultrafast pump-probe study on the compound across the transition temperature. The phase transition leads to abrupt changes of both optical spectra and ultrafast electronic relaxation dynamics. The measurements revealed a sudden reconstruction of band structure. We elaborate that the phase transition is of the first order and can not be attributed to the conventional density-wave type instability. Our work is illuminating for understanding the origin of the structural phase transition.


title: A Survey on Threat Situation Awareness Systems: Framework, Techniques, and Insights

abstract: Cyberspace is full of uncertainty in terms of advanced and sophisticated cyber threats which are equipped with novel approaches to learn the system and propagate themselves, such as AI-powered threats. To debilitate these types of threats, a modern and intelligent Cyber Situation Awareness (SA) system need to be developed which has the ability of monitoring and capturing various types of threats, analyzing and devising a plan to avoid further attacks. This paper provides a comprehensive study on the current state-of-the-art in the cyber SA to discuss the following aspects of SA: key design principles, framework, classifications, data collection, and analysis of the techniques, and evaluation methods. Lastly, we highlight misconceptions, insights and limitations of this study and suggest some future work directions to address the limitations.


title: Large deviations principle for the cubic NLS equation

abstract: In this paper, we present a probabilistic study of rare phenomena of the cubic nonlinear Schr\"odinger equation on the torus in a weakly nonlinear setting. This equation has been used as a model to numerically study the formation of rogue waves in deep sea. Our results are twofold: first, we introduce a notion of criticality and prove a Large Deviations Principle (LDP) for the subcritical and critical cases. Second, we study the most likely initial conditions that lead to the formation of a rogue wave, from a theoretical and numerical point of view. Finally, we propose several open questions for future research.


title: A Riemannian Inexact Newton Dogleg Method for Constructing a Symmetric Nonnegative Matrix with Prescribed Spectrum

abstract: This paper is concerned with the inverse problem of constructing a symmetric nonnegative matrix from realizable spectrum. We reformulate the inverse problem as an underdetermined nonlinear matrix equation over a Riemannian product manifold. To solve it, we develop a Riemannian underdetermined inexact Newton dogleg method for solving a general underdetermined nonlinear equation defined between Riemannian manifolds and Euclidean spaces. The global and quadratic convergence of the proposed method is established under some mild assumptions. Then we solve the inverse problem by applying the proposed method to its equivalent nonlinear matrix equation and a preconditioner for the perturbed normal Riemannian Newton equation is also constructed. Numerical tests show the efficiency of the proposed method for solving the inverse problem.


title: Process Design and Economics of Production of p-Aminophenol

abstract: Para-Aminophenol is one of the key chemicals required for the synthesis of Paracetamol, an analgesic and antipyretic drug. Data shows a large fraction of India's demand for Para-Aminophenol being met through imports from China. The uncertainty in the India-China relations would affect the supply and price of this "Key Starting Material." This report is a detailed business plan for setting up a plant and producing Para-Aminophenol in India at a competitive price. The plant is simulated in AspenPlus V8 and different Material Balances and Energy Balances calculations are carried out. The plant produces 22.7 kmols Para-Aminophenol per hour with a purity of 99.9%. Along with the simulation, economic analysis is carried out for this plant to determine the financial parameters like Payback Period and Return on Investment.


title: A solar flare driven by thermal conduction observed in mid-infrared

abstract: The mid-infrared (mid-IR) range has been mostly unexplored for the investigation of solar flares. It is only recently that new mid-IR flare observations have begun opening a new window into the response and evolution of the solar chromosphere. These new observations have been mostly performed by the AR30T and BR30T telescopes that are operating in Argentina and Brazil, respectively. We present the analysis of SOL2019-05-15T19:24, a GOES class C2.0 solar flare observed at 30~THz (10$\ \mu$m) by the ground-based telescope AR30T. Our aim is to characterize the evolution of the flaring atmosphere and the energy transport mechanism in the context of mid-IR emission. We performed a multi-wavelength analysis of the event by complementing the mid-IR data with diverse ground- and space-based data from the Solar Dynamics Observatory (SDO), the H--$\alpha$ Solar Telescope for Argentina (HASTA), and the Expanded Owens Valley Solar Array (EOVSA). Our study includes the analysis of the magnetic field evolution of the flaring region and of the development of the flare. The mid-IR images from AR30T show two bright and compact flare sources that are spatially associated with the flare kernels observed in ultraviolet (UV) by SDO. We confirm that the temporal association between mid-IR and UV fluxes previously reported for strong flares is also observed for this small flare. The EOVSA microwave data revealed flare spectra consistent with thermal free-free emission, which lead us to dismiss the existence of a significant number of non-thermal electrons. We thus consider thermal conduction as the primary mechanism responsible for energy transport. Our estimates for the thermal conduction energy and total radiated energy fall within the same order of magnitude, reinforcing our conclusions.


title: Supercurrent diode effect and magnetochiral anisotropy in few-layer NbSe$_2$

abstract: Nonreciprocal transport refers to charge transfer processes that are sensitive to the bias polarity. Until recently, nonreciprocal transport was studied only in dissipative systems, where the nonreciprocal quantity is the resistance. Recent experiments have, however, demonstrated nonreciprocal supercurrent leading to the observation of a supercurrent diode effect in Rashba superconductors, opening the vision of dissipationless electronics. Here we report on a supercurrent diode effect in NbSe$_2$ constrictions obtained by patterning NbSe$_2$ flakes with both even and odd layer number. The observed rectification is driven by valley-Zeeman spin-orbit interaction. We demonstrate a rectification efficiency as large as 60%, considerably larger than the efficiency of devices based on Rashba superconductors. In agreement with recent theory for superconducting transition metal dichalcogenides, we show that the effect is driven by an out-of-plane magnetic field component. Remarkably, we find that the effect becomes field-asymmetric in the presence of an additional in-plane field component transverse to the current direction. Supercurrent diodes offer a further degree of freedom in designing superconducting quantum electronics with the high degree of integrability offered by van der Waals materials.


title: Coupling between long ranged repulsions and short ranged attractions in a colloidal model of zero shear rate viscosity

abstract: In this work, we analyzed an isotropic colloidal model incorporating both short-range sticky attractions and long-range electrostatic repulsions. We computed the zero-shear viscosity and second virial coefficient for a dilute colloidal suspension (i.e., pair interactions only) as a function of the strength of attractions and repulsions. We also developed an analytical approximation that allows us to better understand the coupling of the two types of interactions. The attractions and repulsions contribute to the zero-shear viscosity and second virial coefficient in different ways, leading to cases with the same second virial coefficient but different zero-shear viscosity. The analytical approximation shows that the mechanism of the coupling of interactions is that long-range repulsions can weaken the influence of short-range attractions. This effect alters how repulsions change the zero-shear viscosity. Acting independently, both attractions and repulsions increase the viscosity coefficient of the system. However, when both type of interactions are considered together, repulsions can screen the effect of attractive interactions thereby reducing the viscosity.


title: Modeling of polymer-enzyme conjugates formation: Thermodynamic perturbation theory and computer simulations

abstract: A simple model for the formation of the polymer-enzyme conjugates has been proposed and described using corresponding extension of the Wertheim's first-order thermodynamic perturbation theory (TPT1) for the system of associating chain molecules. A set of computer simulation data for different number of functional groups along polymer chains has been obtained and used to access the accuracy of the theoretical results. Predictions of the present theoretical approach are more accurate than that of the conventional TPT1 and are in a very good agreement with the computer simulation data. In particular the theory is able to account for the difference in position of the polymer functional groups along its backbone.


title: Theory and phenomenology of Dirac neutrinos

abstract: In this thesis I discuss in some detail the possibility that neutrinos are Dirac. If this is indeed the case, some extra symmetries beyond the Standard Model gauge group need to be enforced in order to protect Diracness and the smallness of neutrino mass. These symmetries may have a deep connection with other physics sectors, like Dark Matter stability. I also review the general seesaw framework applied to Dirac neutrinos in a model-independent way thanks to the analysis of generalized Weinberg operators and give some simple, elegant UV complete examples both for seesaw variants and radiative mass models. Finally I study in some detail two models with very rich phenomenological predictions.


title: Direct emission spectroscopy of exoplanets with the medium resolution imaging spectrometer on board JWST MIRI: I. Molecular mapping and sensitivity to instrumental effects

abstract: The Medium Resolution Spectrometer on board JWST/MIRI will give access to mid-IR spectra while retaining spatial information. With the unparalleled sensitivity of JWST and the MIRI detectors, the MRS has the potential to revolutionise our understanding of giant exoplanet atmospheres. Molecular mapping is a promising detection and characterisation technique used to study the spectra of directly imaged exoplanets. We aim to examine the feasibility and application of this technique to MRS observations. We used the instrument simulator MIRISIM to create mock observations of resolved star and exoplanet systems. As an input for the simulator, we used stellar and planet parameters from literature, with the planet spectrum being modelled with the radiative transfer code petitRADTRANS. After processing the raw data with the JWST pipeline, we high pass filter the data to account for the stellar point spread function, and used a forward modelling approach to detect the companions and constrain the chemical composition of their atmospheres through their molecular signatures. We identified limiting factors in spectroscopic characterisation of directly imaged exoplanets with the MRS and simulated observations of two representative systems, HR8799 and GJ504. In both systems, we could detect the presence of multiple molecules that were present in the input model of their atmospheres. We used two different approaches with single molecule forward models, used in literature, that are sensitive to detecting mainly H$_2$O, CO, CH$_4$, and NH$_3$, and a log-likelihood ratio test that uses full atmosphere forward models and is sensitive to a larger number of less dominant molecular species. We show that the MIRI MRS can be used to characterise widely separated giant exoplanets in the mid-IR using molecular mapping.


title: On Structural Parameterizations of the Offensive Alliance Problem

abstract: The Offensive Alliance problem has been studied extensively during the last twenty years. A set $S\subseteq V$ of vertices is an offensive alliance in an undirected graph $G=(V,E)$ if each $v\in N(S)$ has at least as many neighbours in $S$ as it has neighbours (including itself) not in $S$. We study the parameterized complexity of the Offensive Alliance problem, where the aim is to find a minimum size offensive alliance. Our focus here lies on parameters that measure the structural properties of the input instance. We enhance our understanding of the problem from the viewpoint of parameterized complexity by showing that the problem is W[1]-hard parameterized by a wide range of fairly restrictive structural parameters such as the feedback vertex set number, treewidth, pathwidth, and treedepth of the input graph.


title: Elucidating Pathfinding Elements from the Kubi Gold Mine in Ghana

abstract: X-ray photoelectron spectroscopy (XPS) and energy-dispersive X-ray spectroscopy (EDX) are applied to investigate the properties of fine-grained concentrate on artisanal small-scale gold mining samples from the Kubi Gold Project of the Asante Gold Corporation near Dunwka-on-Offin in the Central Region of Ghana. Both techniques show that the Au-containing residual sediments are dominated by the host elements Fe, Ag, Al, N, O, Si, Hg, and Ti that either form alloys with gold or inherent elements in the sediments. For comparison, a bulk nugget sample mainly consisting of Au forms an electrum i.e., a solid solution with Ag. Untreated (impure) sediments, fine-grained Au concentrate, coarse-grained Au concentrate, and processed ore (Au bulk/nugget) samples were found to contain cluster of O, C, N, and Ag with Au concentrations significantly lower than that of the related elements. This finding can be attributed to primary geochemical dispersion, which evolved from crystallization of magma and hydrothermal liquids as well as migration of metasomatic elements and rapid rate of chemical weathering of lateralization in secondary processes. The results indicate that Si and Ag are strongly concomitants with Au because of their eutectic characteristics N, C, and O follow alongside because of their affinity to Si. These non-noble elements thus act as pathfinders of Au ores in the exploration area. The paper further discusses relationships between gold and sediments of auriferous lodes as key to determine indicator minerals of gold in mining sites


title: The electroweak Hamiltonian in the gradient flow formalism

abstract: Over the last decade the gradient flow formalism has become an important tool for lattice simulations of Quantum Chromodynamics. It offers remarkable renormalization properties which pave the way for cross-fertilization between perturbative and lattice calculations. In this contribution we report on the construction of the flowed operator product expansion for the current-current operators of the electroweak Hamiltonian at NNLO QCD. This allows for simpler transformations between lattice and perturbative schemes and might reduce the uncertainties of theoretical predictions for low-energy flavor observables.


title: Formation of Fano resonance in double quantum dot system

abstract: Transient electron dynamics and the Fano resonance formation over time in transport through a two quantum dot system in a T-shape geometry (2QD-T) are analysed for free electrons. Time evolution of the transport characteristics are different for a weak and a strong inter-dot coupling with respect to the dot-electrode coupling. When the dot-dot coupling is weak, we find that transport dynamics is governed by two channel tunneling processes with two different relaxation times and buildup of the Fano resonance is developed much slower, with the longer relaxation time. In the opposite limit, the transmission evolves with a single relaxation time, from the single peak resonance structure into the structure with two asymmetric peaks. One observes large dot-electrode charge oscillations, which can temporarily change direction of transient currents. We find also that the time evolution of entanglement is different in both coupling regimes; in particular rapid Rabi oscillations caused by coherent electron transfer between the 2QD states can be seen for the strong dot-dot coupling.