title: Robust parameter design for Wiener-based binaural noise reduction methods in hearing aids

abstract: This work presents a method for designing the weighting parameter required by Wiener-based binaural noise reduction methods. This parameter establishes the desired tradeoff between noise reduction and binaural cue preservation in hearing aid applications. The proposed strategy was specially derived for the preservation of interaural level difference, interaural time difference and interaural coherence binaural cues. It is defined as a function of the average input noise power at the microphones, providing robustness against the influence of joint changes in noise and speech power (Lombard effect), as well as to signal to noise ratio (SNR) variations. A theoretical framework, based on the mathematical definition of the homogeneity degree, is presented and applied to a generic augmented Wiener-based cost function. The theoretical insights obtained are supported bycomputational simulations and psychoacoustic experiments using the multichannel Wiener filter with interaural transfer function preservation technique (MWF-ITF), as a case study. Statistical analysis indicates that the proposed dynamic structure for the weighting parameter and the design method of its fixed part provide significant robustness against changes in the original binaural cues of both speech and residual noise, at the cost of a small decrease in the noise reduction performance, as compared to the use of a purely fixed weighting parameter.


title: MELOPPR: Software/Hardware Co-design for Memory-efficient Low-latency Personalized PageRank

abstract: Personalized PageRank (PPR) is a graph algorithm that evaluates the importance of the surrounding nodes from a source node. Widely used in social network related applications such as recommender systems, PPR requires real-time responses (latency) for a better user experience. Existing works either focus on algorithmic optimization for improving precision while neglecting hardware implementations or focus on distributed global graph processing on large-scale systems for improving throughput rather than response time. Optimizing low-latency local PPR algorithm with a tight memory budget on edge devices remains unexplored. In this work, we propose a memory-efficient, low-latency PPR solution, namely MeLoPPR, with largely reduced memory requirement and a flexible trade-off between latency and precision. MeLoPPR is composed of stage decomposition and linear decomposition and exploits the node score sparsity: Through stage and linear decomposition, MeLoPPR breaks the computation on a large graph into a set of smaller sub-graphs, that significantly saves the computation memory; Through sparsity exploitation, MeLoPPR selectively chooses the sub-graphs that contribute the most to the precision to reduce the required computation. In addition, through software/hardware co-design, we propose a hardware implementation on a hybrid CPU and FPGA accelerating platform, that further speeds up the sub-graph computation. We evaluate the proposed MeLoPPR on memory-constrained devices including a personal laptop and Xilinx Kintex-7 KC705 FPGA using six real-world graphs. First, MeLoPPR demonstrates significant memory saving by 1.5x to 13.4x on CPU and 73x to 8699x on FPGA. Second, MeLoPPR allows flexible trade-offs between precision and execution time: when the precision is 80%, the speedup on CPU is up to 15x and up to 707x on FPGA; when the precision is around 90%, the speedup is up to 70x on FPGA.


title: Operationalizing a National Digital Library: The Case for a Norwegian Transformer Model

abstract: In this work, we show the process of building a large-scale training set from digital and digitized collections at a national library. The resulting Bidirectional Encoder Representations from Transformers (BERT)-based language model for Norwegian outperforms multilingual BERT (mBERT) models in several token and sequence classification tasks for both Norwegian Bokm{\aa}l and Norwegian Nynorsk. Our model also improves the mBERT performance for other languages present in the corpus such as English, Swedish, and Danish. For languages not included in the corpus, the weights degrade moderately while keeping strong multilingual properties. Therefore, we show that building high-quality models within a memory institution using somewhat noisy optical character recognition (OCR) content is feasible, and we hope to pave the way for other memory institutions to follow.


title: Dissensus Algorithms for Opinion Dynamics on the Sphere

abstract: In this paper, novel dissensus algorithms based on the Oja principal component analysis (PCA) flow are proposed to model opinion dynamics on the unit sphere. The information of the covariance formed by the opinion state of each agent is used to achieve a dissensus equilibrium on unsigned graphs. This differs from most of the existing work where antagonistic interactions represented by negative weights in signed graphs are used to achieve a dissensus equilibrium. The nonlinear algorithm is analyzed under both constant covariance and time-varying covariance leading to different behaviors. Stability analysis for the unstable consensus and stable dissensus equilibria is provided under various conditions. The performance of the algorithm is illustrated through a simulation experiment of a multi-agent system.


title: Mesoscale phase separation of skyrmion-vortex matter in chiral magnet-superconductor heterostructures

abstract: We investigate theoretically the equilibrium configurations of many magnetic skyrmions interacting with many superconducting vortices in a superconductor-chiral magnet bilayer. We show that miscible mixtures of vortices and skyrmions in this system breaks down at a particular wave number for sufficiently strong coupling, giving place to remarkably diverse mesoscale patterns: gel, stripes, clusters, intercalated stripes and composite gel-cluster structures. We also demonstrate that, by appropriate choice of parameters, one can thermally tune between the homogeneous and density-modulated phases.


title: Predictor-Corrector(PC) Temporal Difference(TD) Learning (PCTD)

abstract: Using insight from numerical approximation of ODEs and the problem formulation and solution methodology of TD learning through a Galerkin relaxation, I propose a new class of TD learning algorithms. After applying the improved numerical methods, the parameter being approximated has a guaranteed order of magnitude reduction in the Taylor Series error of the solution to the ODE for the parameter $\theta(t)$ that is used in constructing the linearly parameterized value function. Predictor-Corrector Temporal Difference (PCTD) is what I call the translated discrete time Reinforcement Learning(RL) algorithm from the continuous time ODE using the theory of Stochastic Approximation(SA). Both causal and non-causal implementations of the algorithm are provided, and simulation results are listed for an infinite horizon task to compare the original TD(0) algorithm against both versions of PCTD(0).


title: Engineering Sketch Generation for Computer-Aided Design

abstract: Engineering sketches form the 2D basis of parametric Computer-Aided Design (CAD), the foremost modeling paradigm for manufactured objects. In this paper we tackle the problem of learning based engineering sketch generation as a first step towards synthesis and composition of parametric CAD models. We propose two generative models, CurveGen and TurtleGen, for engineering sketch generation. Both models generate curve primitives without the need for a sketch constraint solver and explicitly consider topology for downstream use with constraints and 3D CAD modeling operations. We find in our perceptual evaluation using human subjects that both CurveGen and TurtleGen produce more realistic engineering sketches when compared with the current state-of-the-art for engineering sketch generation.


title: A proposal for Transversal Computer-related Strategies & Services for Scientific and Training efforts for the LASF4RI

abstract: This schematic proposal is looking to give a first view of the different and vital services, protocols, tools and know-how relative to the Scientific Computing (SC) and Information Technology (IT) for scientific endeavours and capacity-building projects in the Latin America region. The proposal of transversal services and protocols for the design, development, deployment, distribution, training, publication and citation, proper accreditation and dissemination of scientific experiments, data, processes, software, documentation, results and resources using world-leading protocols and industrial standards under the Open Access philosophy is presented. It shows a dedicated review of scenarios and proposals that can be seen under the umbrella of a "SC+IT Hub". It also gives effective usage of current hybrid spaces (physical and virtual) that contains very well known industrial and academic resources and practical ideas and how to deploy those for current *diverse* and future experiments and research teams in the region.


title: The mixed deep energy method for resolving concentration features in finite strain hyperelasticity

abstract: The introduction of Physics-informed Neural Networks (PINNs) has led to an increased interest in deep neural networks as universal approximators of PDEs in the solid mechanics community. Recently, the Deep Energy Method (DEM) has been proposed. DEM is based on energy minimization principles, contrary to PINN which is based on the residual of the PDEs. A significant advantage of DEM, is that it requires the approximation of lower order derivatives compared to formulations that are based on strong form residuals. However both DEM and classical PINN formulations struggle to resolve fine features of the stress and displacement fields, for example concentration features in solid mechanics applications. We propose an extension to the Deep Energy Method (DEM) to resolve these features for finite strain hyperelasticity. The developed framework termed mixed Deep Energy Method (mDEM) introduces stress measures as an additional output of the NN to the recently introduced pure displacement formulation. Using this approach, Neumann boundary conditions are approximated more accurately and the accuracy around spatial features which are typically responsible for high concentrations is increased. In order to make the proposed approach more versatile, we introduce a numerical integration scheme based on Delaunay integration, which enables the mDEM framework to be used for random training point position sets commonly needed for computational domains with stress concentrations. We highlight the advantages of the proposed approach while showing the shortcomings of classical PINN and DEM formulations. The method is offering comparable results to Finite-Element Method (FEM) on the forward calculation of challenging computational experiments involving domains with fine geometric features and concentrated loads.


title: Transient nuclear inversion by X-Ray Free Electron Laser in a tapered x-ray waveguid

abstract: By restricting the spatial energy transmission of an electromagnetic wave, dielectric waveguides transmit light over long distances at sustained intensity. Waveguides have been used in the microwave and optical range to maintain strong signal intensities in connection with lasers, but guiding of intense short-wavelength radiation such as x-rays has proven more cumbersome. Here we investigate theoretically how tapered x-ray waveguides can focus and guide radiation from x-ray free electron lasers. Elliptical waveguides using a cladding material with high atomic number such as platinum can maintain an x-ray intensity up to three orders of magnitude larger than in free space. This feature can be used to significantly enhance resonant interactions of x-rays, for instance driving nuclear transitions up to transient nuclear population inversion. This could be the first breakthrough in nuclear state population control. Our results anticipate the important role of tapered x-ray waveguides in the emerging field of x-ray quantum optics with nuclear transitions.


title: Finite Difference Nets: A Deep Recurrent Framework for Solving Evolution PDEs

abstract: There has been an arising trend of adopting deep learning methods to study partial differential equations (PDEs). In this paper, we introduce a deep recurrent framework for solving time-dependent PDEs without generating large scale data sets. We provide a new perspective, that is, a different type of architecture through exploring the possible connections between traditional numerical methods (such as finite difference schemes) and deep neural networks, particularly convolutional and fully-connected neural networks. Our proposed approach will show its effectiveness and efficiency in solving PDE models with an integral form, in particular, we test on one-way wave equations and system of conservation laws.


title: Complexity and the Big Bang

abstract: After a brief review of current scenarios for the resolution and/or avoidance of the Big Bang, an alternative hypothesis is put forward implying an infinite increase in complexity towards the initial singularity. This may result in an effective non-calculability which would present an obstruction to actually reaching the beginning of time. This proposal is motivated by the appearance of certain infinite-dimensional duality symmetries of indefinite Kac--Moody type in attempts to unify gravity with the fundamental matter interactions, and deeply rooted in properties of Einstein's theory.


title: Inference of Upcoming Human Grasp Using EMG During Reach-to-Grasp Movement

abstract: Electromyography (EMG) data has been extensively adopted as an intuitive interface for instructing human-robot collaboration. A major challenge of the real-time detection of human grasp intent is the identification of dynamic EMG from hand movements. Previous studies mainly implemented steady-state EMG classification with a small number of grasp patterns on dynamic situations, which are insufficient to generate differentiated control regarding the muscular activity variation in practice. In order to better detect dynamic movements, more EMG variability could be integrated into the model. However, only limited research were concentrated on such detection of dynamic grasp motions, and most existing assessments on non-static EMG classification either require supervised ground-truth timestamps of the movement status, or only contain limited kinematic variations. In this study, we propose a framework for classifying dynamic EMG signals into gestures, and examine the impact of different movement phases, using an unsupervised method to segment and label the action transitions. We collected and utilized data from large gesture vocabularies with multiple dynamic actions to encode the transitions from one grasp intent to another based on common sequences of the grasp movements. The classifier for identifying the gesture label was constructed afterwards based on the dynamic EMG signal, with no supervised annotation of kinematic movements required. Finally, we evaluated the performances of several training strategies using EMG data from different movement phases, and explored the information revealed from each phase. All experiments were evaluated in a real-time style with the performance transitions over time presented.


title: Lepton Flavour Violation in a radiative neutrino mass model with the asymmetric Yukawa structure

abstract: Though models with the radiative neutrino mass generation are phenomenologically attractive, the complicated relationship between the flavour structure of additional Yukawa matrices and the neutrino mass matrix sometimes is a barrier to explore the models. We introduce a simple prescription to analyze the relation in a class of models with the asymmetric Yukawa structure. We then apply the treatment to the Zee-Babu model as a concrete example of the class and discuss the phenomenological consequences of the model. The combined studies among the neutrino physics, the lepton flavour violation, and the search for the new particles at the collider experiments provide the anatomy of the Zee-Babu model.


title: Characterizing the UAV-to-Machine UWB Radio Channel in Smart Factories

abstract: In this work, the results of Ultra-Wideband air-to-ground measurements carried out in a real-world factory environment are presented and discussed. With intelligent in-dustrial deployments in mind, we envision a scenario where the Unmanned Aerial Vehicle can be used as a supplementary tool for factory operation, optimization and control. Measurements address narrow band and wide band characterization of the wireless radio channel, and can be used for link budget calculation, interference studies and time dispersion assessment in real factories, without the usual limitation for both radio terminals to be close to ground. The measurements are performed at different locations and different heights over the 3.1-5.3 GHz band. Some fundamental propagation parameters values are determined vs. distance, height and propagation conditions. The measurements are complemented with, and compared to, conventional ground-to-ground measurements with the same setup. The conducted measurement campaign gives an insight for realizing wireless applications in smart connected factories, including UAV-assisted applications.


title: Quaternion Generative Adversarial Networks

abstract: Latest Generative Adversarial Networks (GANs) are gathering outstanding results through a large-scale training, thus employing models composed of millions of parameters requiring extensive computational capabilities. Building such huge models undermines their replicability and increases the training instability. Moreover, multi-channel data, such as images or audio, are usually processed by realvalued convolutional networks that flatten and concatenate the input, often losing intra-channel spatial relations. To address these issues related to complexity and information loss, we propose a family of quaternion-valued generative adversarial networks (QGANs). QGANs exploit the properties of quaternion algebra, e.g., the Hamilton product, that allows to process channels as a single entity and capture internal latent relations, while reducing by a factor of 4 the overall number of parameters. We show how to design QGANs and to extend the proposed approach even to advanced models.We compare the proposed QGANs with real-valued counterparts on several image generation benchmarks. Results show that QGANs are able to obtain better FID scores than real-valued GANs and to generate visually pleasing images. Furthermore, QGANs save up to 75% of the training parameters. We believe these results may pave the way to novel, more accessible, GANs capable of improving performance and saving computational resources.


title: Freezing molecules with light: How long can one maintain a non-equilibrium molecular geometry by strong light-matter coupling?

abstract: In molecular photochemistry, the non-equilibrium character and subsequent ultrafast relaxation dynamics of photoexcitations near the Franck-Condon region limit the control of their chemical reactivity. We address how to harness strong light-matter coupling in optical microcavities to isolate and preferentially select specific reaction pathways out of the myriad of possibilities present in large-scale complex systems. Using Fermi's Golden Rule and realistic molecular parameters, we estimate the extent to which molecular configurations can be "locked" into non-equilibrium excited state configurations for timescales well beyond their natural relaxation times. For upper polaritons--which are largely excitonic in character, molecular systems can be locked into their ground state geometries for tens to thousands of picoseconds and varies with the strength of the exciton/phonon coupling (Huang-Rhys parameter). On the other hand, relaxed LP lifetimes are nearly uniformly distributed between 2.1-2.4\,ps and are nearly independent of the Huang-Rhys parameter.


title: Searching for Scientific Evidence in a Pandemic: An Overview of TREC-COVID

abstract: We present an overview of the TREC-COVID Challenge, an information retrieval (IR) shared task to evaluate search on scientific literature related to COVID-19. The goals of TREC-COVID include the construction of a pandemic search test collection and the evaluation of IR methods for COVID-19. The challenge was conducted over five rounds from April to July, 2020, with participation from 92 unique teams and 556 individual submissions. A total of 50 topics (sets of related queries) were used in the evaluation, starting at 30 topics for Round 1 and adding 5 new topics per round to target emerging topics at that state of the still-emerging pandemic. This paper provides a comprehensive overview of the structure and results of TREC-COVID. Specifically, the paper provides details on the background, task structure, topic structure, corpus, participation, pooling, assessment, judgments, results, top-performing systems, lessons learned, and benchmark datasets.


title: Ultrafilter selection and Corson compacta

abstract: We study the question which Boolean algebras have the property that for every generating set there is an ultrafilter selecting maximal number of its elements. We call it the ultrafilter selection property. For cardinality aleph-one the property is equivalent to the fact that the space of ultrafilters is not Corson compact. We also consider the pointwise topology on a Boolean algebra, proving a result on the Lindel\"of number in the context of the ultrafilter selection property. Finally, we discuss poset Boolean algebras, interval algebras, and semilattices in the context of ultrafilter selection properties.


title: Shrinking targets on square-tiled surfaces

abstract: We study a shrinking target problem on square-tiled surfaces. We show that the action of a subgroup of the Veech group of a regular square-tiled surface exhibits Diophantine properties. This generalizes the work of Finkelshtein, who studied a similar problem on the flat torus.


title: Refining Targeted Syntactic Evaluation of Language Models

abstract: Targeted syntactic evaluation of subject-verb number agreement in English (TSE) evaluates language models' syntactic knowledge using hand-crafted minimal pairs of sentences that differ only in the main verb's conjugation. The method evaluates whether language models rate each grammatical sentence as more likely than its ungrammatical counterpart. We identify two distinct goals for TSE. First, evaluating the systematicity of a language model's syntactic knowledge: given a sentence, can it conjugate arbitrary verbs correctly? Second, evaluating a model's likely behavior: given a sentence, does the model concentrate its probability mass on correctly conjugated verbs, even if only on a subset of the possible verbs? We argue that current implementations of TSE do not directly capture either of these goals, and propose new metrics to capture each goal separately. Under our metrics, we find that TSE overestimates systematicity of language models, but that models score up to 40% better on verbs that they predict are likely in context.


title: Rapid Exponential Stabilization of a Boussinesq System of KdV--KdV Type

abstract: This paper studies the exponential stabilization of a Boussinesq system describing the two-way propagation of small amplitude gravity waves on the surface of an ideal fluid, the so-called Boussinesq system of the Korteweg-de Vries type. We use a Gramian-based method introduced by Urquiza to design our feedback control. By means of spectral analysis and Fourier expansion, we show that the solutions of the linearized system decay uniformly to zero when the feedback control is applied. The decay rate can be chosen as large as we want. The main novelty of our work is that we can exponentially stabilize this system of two coupled equations using only one scalar input.


title: Quantum hub and authority centrality measures for directed networks based on continuous-time quantum walks

abstract: In this work we introduce, test and discuss three quantum methods for computing hub and authority centrality scores in directed networks. The methods are based on unitary, continuous-time quantum walks; the construction of a suitable Hermitian Hamiltonian is achieved by performing a quantum walk on the associated bipartite graph. Two methods, called CQAu and CQAw, use the same evolution operator, inspired by the classical HITS algorithm, but with different initial states; the computation of hub and authority scores is performed simultaneously. The third method, called CQG and inspired by classical PageRank, requires instead two separate runs with different evolution operators, one for hub and one for authority scores. The methods are tested on several directed graphs with different sizes and properties; a comparison with other well-established ranking algorithms is provided. CQAw emerges as the most reliable of the three methods and yields rankings that are largely compatible with results from HITS, although CQAu and CQG also present interesting features and potential for applications.


title: Using silicon-vacancy centers in diamond to probe the full strain tensor

abstract: An ensemble of silicon vacancy centers in diamond (\ce{SiV-}) is probed using two coherent spectroscopy techniques. Two main distinct families of \ce{SiV-} centers are identified using multidimensional coherent spectroscopy, and these families are paired with two orientation groups by comparing spectra from different linear polarizations of the incident laser. By tracking the peak centers in the measured spectra, the full diamond strain tensor is calculated local to the laser spot. Such measurements are made at multiple points on the sample surface and variations in the strain tensor are observed.


title: Magnetar Models of Superluminous Supernovae from the Dark Energy Survey: Exploring Redshift Evolution

abstract: Superluminous supernovae (SLSNe) are luminous transients that can be detected to high redshifts with upcoming optical time-domain surveys such as the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). An interesting open question is whether the properties of SLSNe evolve through cosmic time. To address this question, in this paper we model the multi-color light curves of all 21 Type I SLSNe from the Dark Energy Survey (DES) with a magnetar spin-down engine, implemented in the Modular Open Source Fitter for Transients (MOSFiT). With redshifts up to $z\approx 2$, this sample includes some of the highest-redshift SLSNe. We find that the DES SLSNe span a similar range of ejecta and magnetar engine parameters to previous samples of mostly lower-redshift SLSNe (spin period $P\approx 0.79-13.61$ ms, magnetic field $B\approx (0.03-7.33)\times10^{14}$ G, ejecta mass $M_{\rm ej}\approx 1.54-30.32$ M$_{\odot}$, and ejecta velocity $v_{\rm ej}\approx (0.55-1.45)\times 10^4$ km s$^{-1}$). The DES SLSN sample by itself exhibits the previously found negative correlation between $M_{\rm ej}$ and $P$, with a pronounced absence of SLSNe with low ejecta mass and rapid spin. Combining our results for the DES SLSNe with 60 previous SLSNe modeled in the same way, we find no evidence for redshift evolution in any of the key physical parameters.


title: Epicyclic oscillations in spinning particle motion around Kerr black hole applied in models fitting the quasi-periodic oscillations observed in quasars and microquasars

abstract: The study of the quasi-periodic oscillations (QPOs) of X-ray flux observed in the stellar-mass black hole (BH) binaries or quasars can provide a powerful tool for testing the phenomena occurring in strong gravity regime. We thus fit the data of QPOs observed in the well known quasars as well as microquasars in the framework of the model of geodesic oscillations of Keplerian disks modified for the epicyclic oscillations of spinning test particles orbiting Kerr BHs. We show that the modified geodesic models of QPOs can explain the observational fixed data from the quasars and microquasars but not for all sources. We perform a successful fitting of the high frequency QPOs models of epicyclic resonance and its variants, relativistic precession and its variants, tidal disruption, as well as warped disc models, and discuss the corresponding constraints of parameters of the model, which are the spin $S$ of the test particle, mass $M$ and spin $a$ of the BH.


title: A New Class of Efficient Adaptive Filters for Online Nonlinear Modeling

abstract: Nonlinear models are known to provide excellent performance in real-world applications that often operate in non-ideal conditions. However, such applications often require online processing to be performed with limited computational resources. To address this problem, we propose a new class of efficient nonlinear models for online applications. The proposed algorithms are based on linear-in-the-parameters (LIP) nonlinear filters using functional link expansions. In order to make this class of functional link adaptive filters (FLAFs) efficient, we propose low-complexity expansions and frequency-domain adaptation of the parameters. Among this family of algorithms, we also define the partitioned-block frequency-domain FLAF, whose implementation is particularly suitable for online nonlinear modeling problems. We assess and compare frequency-domain FLAFs with different expansions providing the best possible tradeoff between performance and computational complexity. Experimental results prove that the proposed algorithms can be considered as an efficient and effective solution for online applications, such as the acoustic echo cancellation, even in the presence of adverse nonlinear conditions and with limited availability of computational resources.

categories: cs.LG cs.SD cs.SY eess.AS eess.SP eess.SY


title: Reducing Harmonic Distortion in a 5-Level Cascaded H-bridge Inverter Fed by a 12-Pulse Thyristor Rectifier

abstract: This paper investigates a multilevel inverter with a capability that produces a wide voltage range with high quality. The selective harmonic elimination (SHE) method is considered for a single-phase 5-level cascaded H-bridge (CHB) inverter, in which the particle swarm optimization (PSO) algorithm solves the nonlinear equations. However, eliminating the low-order harmonics has been challenging when a low range of output voltage is required. To surmount such challenges and access to a wide range of output voltage, an adjustable dc-link is introduced that allows the inverter to increase the modulation index, resulting in a significant decrease in total harmonic distortion (THD). In this paper, to regulate the dc-link voltage amount, a 12-pulse rectifier is employed to allow the inverter to produce the output voltage requirements with less distortion. To prove such claims, the PSO algorithm is modified to calculate the optimal angles, as a result, the switching angles are applied in SIMULINK MATLAB to generate a 5-level output voltage.


title: Selective Harmonic Elimination in a Cascaded H-Bridge Multilevel Inverter fed by High-Frequency Isolated DC-DC Converter

abstract: In recent years, the use of multilevel inverter has become popular due to its many advantages. Due to the popularity of multilevel inverters in industries and in applications that require a wide range of voltages, there have been many challenges to achieve high-quality voltage. Many pieces of research have been done to solve the problem of annoying harmonics in multilevel inverters. In this study, pulse width modulation (PWM) has been proposed as a switching method. Using the Selective Harmonic Elimination (SHE) technique, the inverter switching can be carried out in low frequency, and also, this method can reduce the annoying harmonics significantly. However, in the lower modulation index, eliminating such harmonics is challenging, resulting in a considerable increase in output voltage distortion. This study suggests a way to solve the problem. In this research, eliminating selected harmonics in a multilevel inverter with variable DC links is proposed. The DC-link variable method in this study is to use a high-frequency isolated DC-DC converter. The proposed method is verified on a 5-level Cascaded H-Bridge (CHB) inverter using the SHE-PWM method solved by particle swarm optimization (PSO) algorithm.


title: Neural Language Models with Distant Supervision to Identify Major Depressive Disorder from Clinical Notes

abstract: Major depressive disorder (MDD) is a prevalent psychiatric disorder that is associated with significant healthcare burden worldwide. Phenotyping of MDD can help early diagnosis and consequently may have significant advantages in patient management. In prior research MDD phenotypes have been extracted from structured Electronic Health Records (EHR) or using Electroencephalographic (EEG) data with traditional machine learning models to predict MDD phenotypes. However, MDD phenotypic information is also documented in free-text EHR data, such as clinical notes. While clinical notes may provide more accurate phenotyping information, natural language processing (NLP) algorithms must be developed to abstract such information. Recent advancements in NLP resulted in state-of-the-art neural language models, such as Bidirectional Encoder Representations for Transformers (BERT) model, which is a transformer-based model that can be pre-trained from a corpus of unsupervised text data and then fine-tuned on specific tasks. However, such neural language models have been underutilized in clinical NLP tasks due to the lack of large training datasets. In the literature, researchers have utilized the distant supervision paradigm to train machine learning models on clinical text classification tasks to mitigate the issue of lacking annotated training data. It is still unknown whether the paradigm is effective for neural language models. In this paper, we propose to leverage the neural language models in a distant supervision paradigm to identify MDD phenotypes from clinical notes. The experimental results indicate that our proposed approach is effective in identifying MDD phenotypes and that the Bio- Clinical BERT, a specific BERT model for clinical data, achieved the best performance in comparison with conventional machine learning models.


title: Selecting the Most Effective Nudge: Evidence from a Large-Scale Experiment on Immunization

abstract: Policymakers often choose a policy bundle that is a combination of different interventions in different dosages. We develop a new technique -- treatment variant aggregation (TVA) -- to select a policy from a large factorial design. TVA pools together policy variants that are not meaningfully different and prunes those deemed ineffective. This allows us to restrict attention to aggregated policy variants, consistently estimate their effects on the outcome, and estimate the best policy effect adjusting for the winner's curse. We apply TVA to a large randomized controlled trial that tests interventions to stimulate demand for immunization in Haryana, India. The policies under consideration include reminders, incentives, and local ambassadors for community mobilization. Cross-randomizing these interventions, with different dosages or types of each intervention, yields 75 combinations. The policy with the largest impact (which combines incentives, ambassadors who are information hubs, and reminders) increases the number of immunizations by 44% relative to the status quo. The most cost-effective policy (information hubs, ambassadors, and SMS reminders but no incentives) increases the number of immunizations per dollar by 9.1% relative to status quo.


title: Using Chandra Localizations and Gaia Distances and Proper Motions to Classify Hard X-ray Sources Discovered by INTEGRAL

abstract: Here we report on X-ray observations of ten 17-60 keV sources discovered by the INTEGRAL satellite. The primary new information is sub-arcsecond positions obtained by the Chandra X-ray Observatory. In six cases (IGR J17040-4305, IGR J18017-3542, IGR J18112-2641, IGR J18434-0508, IGR J19504+3318, and IGR J20084+3221), a unique Chandra counterpart is identified with a high degree of certainty, and for five of these sources (all but J19504), Gaia distances or proper motions indicate that they are Galactic sources. For four of these, the most likely classifications are that the sources are magnetic Cataclysmic Variables (CVs). J20084 could be either a magnetic CV or a High Mass X-ray Binary. We classify the sixth source (J19504) as a likely Active Galactic Nucleus (AGN). In addition, we find likely Chandra counterparts to IGR J18010-3045 and IGR J19577+3339, and the latter is a bright radio source and probable AGN. The other two sources, IGR J12529-6351 and IGR J18013-3222 do not have likely Chandra counterparts, indicating that they are transient, highly variable, or highly absorbed.


title: NewsEdits: A Dataset of Revision Histories for News Articles (Technical Report: Data Processing)

abstract: News article revision histories have the potential to give us novel insights across varied fields of linguistics and social sciences. In this work, we present, to our knowledge, the first publicly available dataset of news article revision histories, or NewsEdits. Our dataset is multilingual; it contains 1,278,804 articles with 4,609,430 versions from over 22 English- and French-language newspaper sources based in three countries. Across version pairs, we count 10.9 million added sentences; 8.9 million changed sentences and 6.8 million removed sentences. Within the changed sentences, we derive 72 million atomic edits. NewsEdits is, to our knowledge, the largest corpus of revision histories of any domain.


title: Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation

abstract: We propose combining memory saving techniques with traditional U-Net architectures to increase the complexity of the models on the Brain Tumor Segmentation (BraTS) challenge. The BraTS challenge consists of a 3D segmentation of a 240x240x155x4 input image into a set of tumor classes. Because of the large volume and need for 3D convolutional layers, this task is very memory intensive. To address this, prior approaches use smaller cropped images while constraining the model's depth and width. Our 3D U-Net uses a reversible version of the mobile inverted bottleneck block defined in MobileNetV2, MnasNet and the more recent EfficientNet architectures to save activation memory during training. Using reversible layers enables the model to recompute input activations given the outputs of that layer, saving memory by eliminating the need to store activations during the forward pass. The inverted residual bottleneck block uses lightweight depthwise separable convolutions to reduce computation by decomposing convolutions into a pointwise convolution and a depthwise convolution. Further, this block inverts traditional bottleneck blocks by placing an intermediate expansion layer between the input and output linear 1x1 convolution, reducing the total number of channels. Given a fixed memory budget, with these memory saving techniques, we are able to train image volumes up to 3x larger, models with 25% more depth, or models with up to 2x the number of channels than a corresponding non-reversible network.


title: Insight into the partitioning and clustering mechanism of rare-earth cations in alkali aluminoborosilicate glasses

abstract: Rare-earth (RE) containing alkali aluminoborosilicate glasses find increasingly broad technological applications, with their further development only impeded by yet-poor understanding of coordination environment and structural role of RE ions in glasses. In this work we combine free induction decay (FID)-detected electron paramagnetic resonance (EPR), electron spin echo envelope modulation (ESEEM), and MAS NMR spectroscopies, to examine the coordination environment and the clustering tendencies of RE3+ in a series of peralkaline aluminoborosilicate glasses co-doped with Nd2O3 (0.001-0.1 mol%) and 5 mol% La2O3. Quantitative EPR spectral analysis reveals three different Nd3+ forms coexisting in the glasses: isolated Nd3+ centers, dipole-coupled Nd clusters (Nd-O-X-O-Nd, where X = Si/B/Al), and spin-exchange-coupled Nd clusters, (Nd-O-Nd) and (Nd-O-La-O-Nd). Extensive RE clustering is observed at high RE2O3 concentrations, with more than 90% REs converting to dipole- and exchange-coupled Nd clusters already at [RE2O3] = 0.01 mol%. ESEEM analysis of the EPR-detectable Nd centers indicates a Na/Si-rich environment (four Na+ per Nd3+) for the isolated Nd3+ centers and the Na/Si/B-rich environment (2-3 Na+ and 1-2 boron per each Nd3+) for the dipole-coupled Nd clusters, while the EPR-undetectable exchanged-coupled RE clusters are predicted to exist in a Na/B-rich environment. The RE clustering induces nano-scale glass phase separation, while the Na/B-rich environment of the RE clusters implies a depletion of the same elements from the remaining host glass. Based on our results, we develop a mechanistic model that explains the high tendency of RE3+ to form clusters in alkali aluminoborosilicate glasses.


title: Mapping the Internet: Modelling Entity Interactions in Complex Heterogeneous Networks

abstract: Even though machine learning algorithms already play a significant role in data science, many current methods pose unrealistic assumptions on input data. The application of such methods is difficult due to incompatible data formats, or heterogeneous, hierarchical or entirely missing data fragments in the dataset. As a solution, we propose a versatile, unified framework called `HMill' for sample representation, model definition and training. We review in depth a multi-instance paradigm for machine learning that the framework builds on and extends. To theoretically justify the design of key components of HMill, we show an extension of the universal approximation theorem to the set of all functions realized by models implemented in the framework. The text also contains a detailed discussion on technicalities and performance improvements in our implementation, which is published for download under the MIT License. The main asset of the framework is its flexibility, which makes modelling of diverse real-world data sources with the same tool possible. Additionally to the standard setting in which a set of attributes is observed for each object individually, we explain how message-passing inference in graphs that represent whole systems of objects can be implemented in the framework. To support our claims, we solve three different problems from the cybersecurity domain using the framework. The first use case concerns IoT device identification from raw network observations. In the second problem, we study how malicious binary files can be classified using a snapshot of the operating system represented as a directed graph. The last provided example is a task of domain blacklist extension through modelling interactions between entities in the network. In all three problems, the solution based on the proposed framework achieves performance comparable to specialized approaches.


title: Signatures of topological phase transitions in the s-wave superconductor at finite temperature

abstract: In two dimensions, an s-wave superconductor in the presence of Rashba spin-orbit coupling possesses distinct topologically non-trivial ground state phases controlled by Zeeman splitting and band filling. These phases can be characterized in terms of spin textures in momentum space. Although the spin texture becomes topologically trivial at finite temperatures, we identify thermodynamic signatures that are directly related to the topological phase transitions of the ground state. In particular, relative maxima in the entropy as a function of the magnetic field in the vicinity of topological phase transitions emerge and are attributed to a sign change in the derivative of the magnetization with respect to temperature.


title: Singular Perturbation-based Reinforcement Learning of Two-Point Boundary Optimal Control Systems

abstract: This work presents a technique for learning systems, where the learning process is guided by knowledge of the physics of the system. In particular, we solve the problem of the two-point boundary optimal control problem of linear time-varying systems with unknown model dynamics using reinforcement learning. Borrowing techniques from singular perturbation theory, we transform the time-varying optimal control problem into a couple of time-invariant subproblems. This allows the utilization of an off-policy iteration method to learn the controller gains. We show that the performance of the learning-based controller approximates that of the model-based optimal controller and the accuracy of the approximation improves as the time horizon of the control problem increases. Finally, we provide a simulation example to verify the results of the paper.


title: Modeling "Newsworthiness" for Lead-Generation Across Corpora

abstract: Journalists obtain "leads", or story ideas, by reading large corpora of government records: court cases, proposed bills, etc. However, only a small percentage of such records are interesting documents. We propose a model of "newsworthiness" aimed at surfacing interesting documents. We train models on automatically labeled corpora -- published newspaper articles -- to predict whether each article was a front-page article (i.e., \textbf{newsworthy}) or not (i.e., \textbf{less newsworthy}). We transfer these models to unlabeled corpora -- court cases, bills, city-council meeting minutes -- to rank documents in these corpora on "newsworthiness". A fine-tuned RoBERTa model achieves .93 AUC performance on heldout labeled documents, and .88 AUC on expert-validated unlabeled corpora. We provide interpretation and visualization for our models.


title: Construction method for the Nicolai map in supersymmetric Yang-Mills theories

abstract: Recently, a universal formula for the Nicolai map in terms of a coupling flow functional differential operator was found. We present the full perturbative expansion of this operator in Yang-Mills theories where supersymmetry is realized off-shell. Given this expansion, we develop a straightforward method to compute the explicit Nicolai map to any order in the gauge coupling. Our work extends the previously known construction method from the Landau gauge to arbitrary gauges and from the gauge hypersurface to the full gauge-field configuration space. As an example, we present the map in the axial gauge to the second order.


title: Bridging the gap between numerics and experiment in free standing graphene

abstract: We report results of large-scale quantum Monte Carlo (QMC) simulations of graphene. Using cutting-edge algorithmic improvements, we are able to consider spatial volumes, corresponding to 20808 electrons, that allow us to access energy scales of direct relevance to experiments. Using constrained random phase approximation (cRPA) estimates of short-ranged interactions combined with a Coulomb tail, we are able to successfully confront numerical and experimental estimates of the Fermi velocity renormalization. These results and their comparison with perturbation theory not only show the non-Fermi liquid character of graphene, but also prove the importance of lattice-scale physics and higher-order perturbative corrections beyond RPA for the quantitative description of the experimental data for the Fermi velocity renormalization in suspended graphene.


title: "Don't quote me on that": Finding Mixtures of Sources in News Articles

abstract: Journalists publish statements provided by people, or \textit{sources} to contextualize current events, help voters make informed decisions, and hold powerful individuals accountable. In this work, we construct an ontological labeling system for sources based on each source's \textit{affiliation} and \textit{role}. We build a probabilistic model to infer these attributes for named sources and to describe news articles as mixtures of these sources. Our model outperforms existing mixture modeling and co-clustering approaches and correctly infers source-type in 80\% of expert-evaluated trials. Such work can facilitate research in downstream tasks like opinion and argumentation mining, representing a first step towards machine-in-the-loop \textit{computational journalism} systems.


title: On some properties of polynomial composites

abstract: Polynomial composites were introduced by Anderson, Anderson, and Zafrullah. Over time, composites have appeared in many different papers, but they have not been sorted out in the algebra world. This paper is another part of the study of composites as an algebraic structure. In this paper we complete possible properties for polynomial composites as ACCP, atomic, BFD, HFD, idf, FFD domains. In a separate section, we consider polynomial composites as Dedekind rings.


title: Calibration and Consistency of Adversarial Surrogate Losses

abstract: Adversarial robustness is an increasingly critical property of classifiers in applications. The design of robust algorithms relies on surrogate losses since the optimization of the adversarial loss with most hypothesis sets is NP-hard. But which surrogate losses should be used and when do they benefit from theoretical guarantees? We present an extensive study of this question, including a detailed analysis of the H-calibration and H-consistency of adversarial surrogate losses. We show that, under some general assumptions, convex loss functions, or the supremum-based convex losses often used in applications, are not H-calibrated for important hypothesis sets such as generalized linear models or one-layer neural networks. We then give a characterization of H-calibration and prove that some surrogate losses are indeed H-calibrated for the adversarial loss, with these hypothesis sets. Next, we show that H-calibration is not sufficient to guarantee consistency and prove that, in the absence of any distributional assumption, no continuous surrogate loss is consistent in the adversarial setting. This, in particular, proves that a claim presented in a COLT 2020 publication is inaccurate. (Calibration results there are correct modulo subtle definition differences, but the consistency claim does not hold.) Next, we identify natural conditions under which some surrogate losses that we describe in detail are H-consistent for hypothesis sets such as generalized linear models and one-layer neural networks. We also report a series of empirical results with simulated data, which show that many H-calibrated surrogate losses are indeed not H-consistent, and validate our theoretical assumptions.


title: The $\bar{\partial}$-Neumann problem and boundary integral equations

abstract: In this note, we find an equivalent boundary integral equation to the classical $\bar{\partial}$-Neumann problem. The new equation contains an equivalent regularity to the global regularity of the $\bar{\partial}$-Neumann problem. We also use the integral equations to observe a new-found rigidity property of the $\bar{\partial}$-Neumann problem on the unit ball in $\mathbb{C}^2$.


title: The Galaxy Progenitors of Stellar Streams around Milky Way-mass Galaxies in the FIRE Cosmological Simulations

abstract: Stellar streams record the accretion history of their host galaxy. We present a set of simulated streams from disrupted dwarf galaxies in 13 cosmological simulations of Milky Way (MW)-mass galaxies from the FIRE-2 suite at $z=0$, including 7 isolated Milky Way-mass systems and 6 hosts resembling the MW-M31 pair (full dataset at: https://flathub.flatironinstitute.org/sapfire). In total, we identify 106 simulated stellar streams, with no significant differences in the number of streams and masses of their progenitors between the isolated and paired environments. We resolve simulated streams with stellar masses ranging from $\sim 5\times10^5$ up to $\sim 10^{9} M_\odot$, similar to the mass range between the Orphan and Sagittarius streams in the MW. We confirm that present-day simulated satellite galaxies are good proxies for stellar stream progenitors, with similar properties including their stellar mass function, velocity dispersion, [Fe/H] and [$\alpha$/H] evolution tracks, and orbital distribution with respect to the galactic disk plane. Each progenitor's lifetime is marked by several important timescales: its infall, star-formation quenching, and stream-formation times. We show that the ordering of these timescales is different between progenitors with stellar masses higher and lower than $\sim 2\times10^6 M_\odot$. Finally, we show that the main factor controlling the rate of phase-mixing, and therefore fading, of tidal streams from satellite galaxies in MW-mass hosts is non-adiabatic evolution of the host potential. Other factors commonly used to predict phase-mixing timescales, such as progenitor mass and orbital circularity, show virtually no correlation with the number of dynamical times required for a stream to become phase-mixed.


title: The Hilbert-Schmidt norm as a measure of entanglement in spin-1/2 Heisenberg chain: generalized Bell inequality and distance between states

abstract: In this letter, we show that the measure of entanglement using the generalized Bell inequality and the distance between states coincide when we use the Hilbert-Schmidt norm. Our conclusions apply to the spin-1/2 Heisenberg chains with interaction between the first neighbors.


title: Bloch's cycle complex and coherent dualizing complexes in positive characteristic

abstract: Let $X$ be a separated scheme of dimension $d$ of finite type over a perfect field $k$ of positive characteristic $p$. In this work, we show that Bloch's cycle complex $\mathbb{Z}^c_X$ of zero cycles mod $p^n$ is quasi-isomorphic to the Cartier operator fixed part of a certain dualizing complex from coherent duality theory. From this we obtain new vanishing results for the higher Chow groups of zero cycles with mod $p^n$ coefficients for singular varieties.


title: Aerodynamic sound of turbulent time-developing shear layer as the outcome of the flow linear non-modal instability

abstract: The aim of this paper is to substantiate the importance of non-normality of shear flow linear operators and its consequence -- the non-modal dynamics of the perturbations -- in the formation of acoustic wave output of time-developing free shear/mixing layers. Initially, the linear transient dynamics of spatial Fourier harmonics is considered in a 3D homentropic parallel unbounded inviscid constant shear flow which can model the central/body part of the shear layer. The non-modal approach allows to capture the only linear mechanism of the acoustic wave generation -- \textit{the linear vortex-wave mode coupling induced by the shear flow non-normality}. We describe the specific/key features of the generation process that should leave traces on the further dynamics of the generated waves. Thereafter, the results of direct numerical simulations of compressible turbulent time-developing mixing layers for a moderate convective Mach number (specifically, $M_c=0.7$) and simulation boxes $(L_x,L_y,L_z)$ with fixed streamwise and shearwise lengths ($L_x=100, L_y=200$) and different streamwise-spanwise aspect ratios ($L_x/L_z=0.5,1,2$) are presented. The simulations identify the origin of the acoustic wave output: the dominance of a \emph{linear generation process of acoustic waves in the shear layer core region, induced by the flow non-normality}, observable in the near field of acoustic waves emitted by the flow.


title: Construction of genuinely multipartite entangled subspaces and the associated bounds on entanglement measures for mixed states

abstract: Genuine entanglement is the strongest form of multipartite entanglement. Genuinely entangled pure states contain entanglement in every bipartition and as such can be regarded as a valuable resource in the protocols of quantum information processing. A recent direction of research is the construction of genuinely entangled subspaces -- the class of subspaces consisting entirely of genuinely multipartite entangled pure states. In this paper we present several methods of construction of such subspaces including those of maximal possible dimension. The approach is based on the correspondence between bipartite entangled subspaces and quantum channels of a certain type. The examples include maximal subspaces for systems of three qubits, four qubits, three qutrits. We also provide lower bounds on two entanglement measures for mixed states, the concurrence and the convex-roof extended negativity, which are directly connected with the projection on genuinely entangled subspaces.


title: Learning GMMs with Nearly Optimal Robustness Guarantees

abstract: In this work we solve the problem of robustly learning a high-dimensional Gaussian mixture model with $k$ components from $\epsilon$-corrupted samples up to accuracy $\widetilde{O}(\epsilon)$ in total variation distance for any constant $k$ and with mild assumptions on the mixture. This robustness guarantee is optimal up to polylogarithmic factors. The main challenge is that most earlier works rely on learning individual components in the mixture, but this is impossible in our setting, at least for the types of strong robustness guarantees we are aiming for. Instead we introduce a new framework which we call {\em strong observability} that gives us a route to circumvent this obstacle.


title: Decoherence-free quantum register of nuclear spins in diamond

abstract: Solid-state quantum registers are exceptional for storing quantum information at room temperature with long coherence time. Nevertheless, practical applications toward quantum supremacy require even longer coherence time to allow for more complex algorithms. In this work we propose a quantum register that lies in a decoherence-free subspace to be implemented with color centers in diamond. The quantum information is encoded in two logical states composed of two nearby nuclear spins, while an electron spin is used as ancilla for initialization and control. Moreover, by tuning an off-axis magnetic field we enable non-nuclear-spin-preserving transitions that we use for preparing the register through Stimulating Raman Adiabatic Passage. Furthermore, we use this sequence to manipulate the quantum register and an individual nuclear spin.


title: Manipulating SGD with Data Ordering Attacks

abstract: Machine learning is vulnerable to a wide variety of attacks. It is now well understood that by changing the underlying data distribution, an adversary can poison the model trained with it or introduce backdoors. In this paper we present a novel class of training-time attacks that require no changes to the underlying dataset or model architecture, but instead only change the order in which data are supplied to the model. In particular, we find that the attacker can either prevent the model from learning, or poison it to learn behaviours specified by the attacker. Furthermore, we find that even a single adversarially-ordered epoch can be enough to slow down model learning, or even to reset all of the learning progress. Indeed, the attacks presented here are not specific to the model or dataset, but rather target the stochastic nature of modern learning procedures. We extensively evaluate our attacks on computer vision and natural language benchmarks to find that the adversary can disrupt model training and even introduce backdoors.


title: Simulation-Based Inference with Approximately Correct Parameters via Maximum Entropy

abstract: Inferring the input parameters of simulators from observations is a crucial challenge with applications from epidemiology to molecular dynamics. Here we show a simple approach in the regime of sparse data and approximately correct models, which is common when trying to use an existing model to infer latent variables with observed data. This approach is based on the principle of maximum entropy (MaxEnt) and provably makes the smallest change in the latent joint distribution to fit new data. This method requires no likelihood or model derivatives and its fit is insensitive to prior strength, removing the need to balance observed data fit with prior belief. The method requires the ansatz that data is fit in expectation, which is true in some settings and may be reasonable in all with few data points. The method is based on sample reweighting, so its asymptotic run time is independent of prior distribution dimension. We demonstrate this MaxEnt approach and compare with other likelihood-free inference methods across three systems: a point particle moving in a gravitational field, a compartmental model of epidemic spread and finally molecular dynamics simulation of a protein.


title: Inferring Drop-in Binary Parsers from Program Executions

abstract: We present BIEBER (Byte-IdEntical Binary parsER), the first system to model and regenerate a full working parser from instrumented program executions. To achieve this, BIEBER exploits the regularity (e.g., header fields and array-like data structures) that is commonly found in file formats. Key generalization steps derive strided loops that parse input file data and rewrite concrete loop bounds with expressions over input file header bytes. These steps enable BIEBER to generalize parses of specific input files to obtain parsers that operate over input files of arbitrary size. BIEBER also incrementally and efficiently infers a decision tree that reads file header bytes to route input files of different types to inferred parsers of the appropriate type. The inferred parsers and decision tree are expressed in an IR; separate backends (C and Perl in our prototype) can translate the IR into the same language as the original program (for a safer drop-in replacement), or automatically port to a different language. An empirical evaluation shows that BIEBER can successfully regenerate parsers for six file formats (waveform audio [1654 files], MT76x0 .BIN firmware containers [5 files], OS/2 1.x bitmap images [9 files], Windows 3.x bitmaps [9971 files], Windows 95/NT4 bitmaps [133 files], and Windows 98/2000 bitmaps [859 files]), correctly parsing 100% (>= 99.98% when using standard held-out cross-validation) of the corresponding corpora. The regenerated parsers contain automatically inserted safety checks that eliminate common classes of errors such as memory errors. We find that BIEBER can help reverse-engineer file formats, because it automatically identifies predicates for the decision tree that relate to key semantics of the file format. We also discuss how BIEBER helped us detect and fix two new bugs in stb_image as well as independently rediscover and fix a known bug.


title: Anisotropic quantum Hall states in the presence of interactions with fourfold rotational symmetry

abstract: We study the effects of anisotropic interactions in the quantum Hall effect in the presence of a fourfold discrete rotational ($C_4$) symmetry. Employing the density matrix renormalization group technique on an infinite cylinder geometry (iDMRG), we calculate the anisotropy response of the Laughlin state at $\nu=1/3$ and the composite-Fermi liquid (CFL) state at $\nu=1/2$. We find that the anisotropy transferred from the interaction potential to the $\nu=1/3$ state is stronger when compared to the complementary case of an anisotropic band. Further, the strength of anisotropy reduces as the interaction is made shorter ranged. Quite surprisingly, at $\nu=1/2$, we find that the deformation in the CF Fermi-surface changes sign as the interaction range is reduced. Our results imply that the short-distance and long-distance parts of the interaction potential have opposite effects on the CFL state in the presence of $C_4$-symmetric anisotropy.


title: Exploiting Underlay Spectrum Sharing in Cell-Free Massive MIMO Systems

abstract: We investigate the coexistence of underlay spectrum sharing in cell-free massive multiple-input multiple-output (MIMO) systems. A primary system with geographically distributed primary access points (P-APs) serves a multitude of primary users (PUs), while a secondary system serves a large number of secondary users (SUs) in the same primary/licensed spectrum by exploiting the underlay spectrum sharing. To mitigate the secondary co-channel interference inflected at PUs, stringent secondary transmit power constraints are defined for the secondary access points (S-APs). A generalized pilots sharing scheme is used to locally estimate the uplink channels at P-APs/S-APs, and thereby, conjugate precoders are adopted to serve PUs/SUs in the same time-frequency resource element. Moreover, the effect of a user-centric AP clustering scheme is investigated by assigning a suitable set of APs to a particular user. The impact of estimated downlink (DL) channels at PUs/SUs via DL pilots beamformed by P-APs/S-APs is investigated. The achievable primary/secondary rates at PUs/SUs are derived for the statistical DL and estimated DL CSI cases. User-fairness for PUs/SUs is achieved by designing efficient transmit power control policies based on a multi-objective optimization problem formulation of joint underlay spectrum sharing and max-min criteria. The proposed orthogonal multiple-access based analytical framework is also extended to facilitate non-orthogonal multiple-access. Our analysis and numerical results manifest that the primary/secondary performance of underlay spectrum sharing can be boosted by virtue of the average reduction of transmit powers/path-losses, uniform coverage/service, and macro-diversity gains, which are inherent to distributed transmissions/receptions of cell-free massive MIMO.


title: REXPACO: an algorithm for high contrast reconstruction of the circumstellar environment by angular differential imaging

abstract: Aims. The purpose of this paper is to describe a new post-processing algorithm dedicated to the reconstruction of the spatial distribution of light received from off-axis sources, in particular from circumstellar disks. Methods. Built on the recent PACO algorithm dedicated to the detection of point-like sources, the proposed method is based on the local learning of patch covariances capturing the spatial fluctuations of the stellar leakages. From this statistical modeling, we develop a regularized image reconstruction algorithm (REXPACO) following an inverse problem approach based on a forward image formation model of the off-axis sources in the ADI sequences. Results. Injections of fake circumstellar disks in ADI sequences from the VLT/SPHERE-IRDIS instrument show that both the morphology and the photometry of the disks are better preserved by REXPACO compared to standard postprocessing methods like cADI. In particular, the modeling of the spatial covariances proves usefull in reducing typical ADI artifacts and in better disentangling the signal of these sources from the residual stellar contamination. The application to stars hosting circumstellar disks with various morphologies confirms the ability of REXPACO to produce images of the light distribution with reduced artifacts. Finally, we show how REXPACO can be combined with PACO to disentangle the signal of circumstellar disks from the signal of candidate point-like sources. Conclusions. REXPACO is a novel post-processing algorithm producing numerically deblurred images of the circumstellar environment. It exploits the spatial covariances of the stellar leakages and of the noise to efficiently eliminate this nuisance term.


title: Crowd motion paradigm modeled by a bilevel sweeping control problem

abstract: This article concerns an optimal crowd motion control problem in which the crowd features a structure given by its organization into N groups (participants) each one spatially confined in a set. The overall optimal control problem consists in driving the ensemble of sets as close as possible to a given point (the 'exit') while the population in each set minimizes its control effort subject to its sweeping dynamics with a controlled state dependent velocity drift. In order to capture the conflict between the goal of the overall population and those of the various groups, the problem is cast as a bilevel optimization framework. A key challenge of this problem consists in bringing together two quite different paradigms: bilevel programming and sweeping dynamics with a controlled drift. Necessary conditions of optimality in the form of a Maximum Principle of Pontryagin in the Gamkrelidze framework are derived. These conditions are then used to solve a simple illustrative example with two participants, emphasizing the interaction between them.


title: Old experiments in new light: Young's double-slit and Stern-Gerlach experiments in liquid crystal microcavities

abstract: Spin-orbit interactions which couple spin of a particle with its momentum degrees of freedom lie at the center of spintronic applications. Of special interest in semiconductor physics are Rashba and Dresselhaus spin-orbit coupling (SOC). When equal in strength, the Rashba and Dresselhaus fields result in SU(2) spin rotation symmetry and emergence of the persistent spin helix (PSH) only investigated for charge carriers in semiconductor quantum wells. Recently, a synthetic Rashba-Dresselhaus Hamiltonian was shown to describe cavity photons confined in a microcavity filled with optically anisotropic liquid crystal. In this work, we present a purely optical realisation of two types of spin patterns corresponding to PSH and the Stern-Gerlach experiment in such a cavity. We show how the symmetry of the Hamiltonian results in spatial oscillations of the spin orientation of photons travelling in the plane of the cavity.


title: A model of COVID-19 pandemic evolution in African countries

abstract: We studied the COVID-19 pandemic evolution in selected African countries. For each country considered, we modeled simultaneously the data of the active, recovered and death cases. In this study, we used a year of data since the first cases were reported. We estimated the time-dependent basic reproduction numbers, $R_0$, and the fractions of infected but unaffected populations, to offer insights into containment and vaccine strategies in African countries. We found that $R_0\leq 4$ at the start of the pandemic but has since fallen to $R_0 \sim 1$. The unaffected fractions of the populations studied vary between $1-10$\% of the recovered cases.


title: Integrable Systems and Spacetime Dynamics

abstract: It is shown that the Ablowitz-Kaup-Newell-Segur (AKNS) integrable hierarchy can be obtained as the dynamical equations of three-dimensional General Relativity with a negative cosmological constant. This geometrization of the AKNS system is possible through the construction of novel boundary conditions for the gravitational field. These are invariant under an asymptotic symmetry group characterized by an infinite set of AKNS commuting conserved charges. Gravitational configurations are studied by means of $SL(2,\mathbb{R})$ conjugacy classes. Conical singularities and black hole solutions are included in the boundary conditions.


title: Large Scale Record Linkage in the Presence of Missing Data

abstract: Record linkage is aimed at the accurate and efficient identification of records that represent the same entity within or across disparate databases. It is a fundamental task in data integration and increasingly required for accurate decision making in application domains ranging from health analytics to national security. Traditional record linkage techniques calculate string similarities between quasi-identifying (QID) values, such as the names and addresses of people. Errors, variations, and missing QID values can however lead to low linkage quality because the similarities between records cannot be calculated accurately. To overcome this challenge, we propose a novel technique that can accurately link records even when QID values contain errors or variations, or are missing. We first generate attribute signatures (concatenated QID values) using an Apriori based selection of suitable QID attributes, and then relational signatures that encapsulate relationship information between records. Combined, these signatures can uniquely identify individual records and facilitate fast and high quality linking of very large databases through accurate similarity calculations between records. We evaluate the linkage quality and scalability of our approach using large real-world databases, showing that it can achieve high linkage quality even when the databases being linked contain substantial amounts of missing values and errors.


title: Generation of highly mutually coherent hard x-ray pulse pairs with an amplitude-splitting delay line

abstract: Beam splitters and delay lines are among the key building blocks of modern-day optical laser technologies. Progress in x-ray free electron laser source development and applications over the past decade is calling for their counter part operating in the Angstrom wavelength regime. Recent efforts in x-ray optics development have demonstrated relatively stable delay lines that most often adopted the division of wavefront approach for the beam splitting and recombination configuration. However, the two recombined beams have yet to achieve sufficient mutual coherence to enable applications such as interferometry, correlation spectroscopy, and nonlinear spectroscopy. We present the first experimental realization of the generation of highly mutually coherent pulse pairs using an amplitude-split delay line design based on transmission grating beam splitters and channel-cut crystal optic delay lines. The performance of the prototype system was analyzed in the context of x-ray coherent scattering and correlation spectroscopy, where we obtained nearly identical high-contrast speckle patterns from both branches. We show in addition the high level of dynamical stability during continuous delay scans, a capability essential for high sensitivity ultra-fast measurements.


title: Engineering the Collapse of Lifetime Distribution of Nitrogen-Vacancy Centers in Nanodiamonds

abstract: We demonstrate experimentally that the distribution of the decay rates of nitrogen-vacancy centers in diamond becomes narrower by over five times for nanodiamonds embedded in thin chalcogenide films.


title: Shufflecast: An Optical, Data-rate Agnostic and Low-Power Multicast Architecture for Next-Generation Compute Clusters

abstract: An optical circuit-switched network core has the potential to overcome the inherent challenges of a conventional electrical packet-switched core of today's compute clusters. As optical circuit switches (OCS) directly handle the photon beams without any optical-electrical-optical (O/E/O) conversion and packet processing, OCS-based network cores have the following desirable properties: a) agnostic to data-rate, b) negligible/zero power consumption, c) no need of transceivers, d) negligible forwarding latency, and e) no need for frequent upgrade. Unfortunately, OCS can only provide point-to-point (unicast) circuits. They do not have built-in support for one-to-many (multicast) communication, yet multicast is fundamental to a plethora of data-intensive applications running on compute clusters nowadays. In this paper, we propose Shufflecast, a novel optical network architecture for next-generation compute clusters that can support high-performance multicast satisfying all the properties of an OCS-based network core. Shufflecast leverages small fanout, inexpensive, passive optical splitters to connect the Top-of-rack (ToR) switch ports, ensuring data-rate agnostic, low-power, physical-layer multicast. We thoroughly analyze Shufflecast's highly scalable data plane, light-weight control plane, and graceful failure handling. Further, we implement a complete prototype of Shufflecast in our testbed and extensively evaluate the network. Shufflecast is more power-efficient than the state-of-the-art multicast mechanisms. Also, Shufflecast is more cost-efficient than a conventional packet-switched network. By adding Shufflecast alongside an OCS-based unicast network, an all-optical network core with the aforementioned desirable properties supporting both unicast and multicast can be realized.


title: Two interacting scalar fields: practical renormalization

abstract: The main theme of the paper is the detailed discussion of the renormalization of the quantum field theory comprising two interacting scalar fields. The potential of the model is the fourth-order homogeneous polynomial of the fields, symmetric with respect to the transformation $\phi_{i}\rightarrow{-\phi_{i}}$. We determine the Feynman rules for the model and then we present a detailed discussion of the renormalization of the theory at one loop. Next, we derive the one loop renormalization group equations for the running masses and coupling constants. At the level of two loops, we use the FeynArts package of Mathematica to generate the two loops Feynman diagrams and calculate in detail the setting sun diagram.


title: Is the Standard Model in the Swampland? Consistency Requirements from Gravitational Scattering

abstract: We study compatibility of the Standard Model of particle physics and General Relativity by means of gravitational positivity bounds, which provide a necessary condition for a low-energy gravitational theory to be UV completable within the weakly coupled regime of gravity. In particular, we identify the cutoff scale of the Standard Model coupled to gravity by studying consistency of light-by-light scattering. While the precise value depends on details of the Pomeron effects in QCD, the cutoff scale reads $10^{16}$GeV if the single-Pomeron exchange picture works well up to this scale. We also demonstrate that the cutoff scale is lowered to $10^{13}$GeV if we consider the electroweak theory without the QCD sector.


title: skweak: Weak Supervision Made Easy for NLP

abstract: We present skweak, a versatile, Python-based software toolkit enabling NLP developers to apply weak supervision to a wide range of NLP tasks. Weak supervision is an emerging machine learning paradigm based on a simple idea: instead of labelling data points by hand, we use labelling functions derived from domain knowledge to automatically obtain annotations for a given dataset. The resulting labels are then aggregated with a generative model that estimates the accuracy (and possible confusions) of each labelling function. The skweak toolkit makes it easy to implement a large spectrum of labelling functions (such as heuristics, gazetteers, neural models or linguistic constraints) on text data, apply them on a corpus, and aggregate their results in a fully unsupervised fashion. skweak is especially designed to facilitate the use of weak supervision for NLP tasks such as text classification and sequence labelling. We illustrate the use of skweak for NER and sentiment analysis. skweak is released under an open-source license and is available at: https://github.com/NorskRegnesentral/skweak


title: Suppressing simulation bias using multi-modal data

abstract: Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is multi-dimensional. Simulations, however, often suffer from an inherent bias. Estimation of this bias may be poorly constrained not only because of data sparsity, but also because traditional predictive models fit only one type of observed outputs, such as scalars or images, instead of all available output data modalities, which might have been acquired and simulated at great cost. To break this limitation and open up the path for multi-modal calibration, we propose to combine a novel, transfer learning technique for suppressing the bias with recent developments in deep learning, which allow building predictive models with multi-modal outputs. First, we train an initial neural network model on simulated data to learn important correlations between different output modalities and between simulation inputs and outputs. Then, the model is partially retrained, or transfer learned, to fit the experiments; a method that has never been implemented in this type of architecture. Using fewer than 10 inertial confinement fusion experiments for training, transfer learning systematically improves the simulation predictions while a simple output calibration, which we design as a baseline, makes the predictions worse. We also offer extensive cross-validation with real and carefully designed synthetic data. The method described in this paper can be applied to a wide range of problems that require transferring knowledge from simulations to the domain of experiments.


title: Accelerated Inexact First-Order Methods for Solving Nonconvex Composite Optimization Problems

abstract: This thesis focuses on developing and analyzing accelerated and inexact first-order methods for solving or finding stationary points of various nonconvex composite optimization (NCO) problems. The main tools mainly come from variational and convex analysis, and the key results are in the form of iteration complexity bounds and how these bounds compare to other ones in the literature.


title: Estimating Traffic Speeds using Probe Data: A Deep Neural Network Approach

abstract: This paper presents a dedicated Deep Neural Network (DNN) architecture that reconstructs space-time traffic speeds on freeways given sparse data. The DNN is constructed in such a way, that it learns heterogeneous congestion patterns using a large dataset of sparse speed data, in particular from probe vehicles. Input to the DNN are two equally sized input matrices: one containing raw measurement data, and the other indicates the cells occupied with data. The DNN, comprising multiple stacked convolutional layers with an encoding-decoding structure and feed-forward paths, transforms the input into a full matrix of traffic speeds. The proposed DNN architecture is evaluated with respect to its ability to accurately reconstruct heterogeneous congestion patterns under varying input data sparsity. Therefore, a large set of empirical Floating-Car Data (FCD) collected on German freeway A9 during two months is utilized. In total, 43 congestion distinct scenarios are observed which comprise moving and stationary congestion patterns. A data augmentation technique is applied to generate input-output samples of the data, which makes the DNN shift-invariant as well as capable of managing varying data sparsities. The DNN is trained and subsequently applied to sparse data of an unseen congestion scenario. The results show that the DNN is able to apply learned patterns, and reconstructs moving as well as stationary congested traffic with high accuracy; even given highly sparse input data. Reconstructed speeds are compared qualitatively and quantitatively with the results of several state-of-the-art methods such as the Adaptive Smoothing Method (ASM), the Phase-Based Smoothing Method (PSM) and a standard Convolutional Neural Network (CNN) architecture. As a result, the DNN outperforms the other methods significantly.


title: Quantitative insights into the phase behaviour and miscibility of organic photovoltaic active layers from the perspective of neutron spectroscopy

abstract: We present a neutron spectroscopy based method to study quantitatively the partial miscibility and phase behaviour of an organic photovoltaic active layer made of conjugated polymer:small molecule blends, presently illustrated with the regio-random poly(3-hexylthiophene-2,5-diyl) and fullerene [6,6]-Phenyl C$_{61}$ butyric acid methyl ester (RRa-P3HT:PCBM) system. We perform both inelastic neutron scattering and quasi-elastic neutron scattering measurements to study the structural dynamics of blends of different compositions enabling us to resolve the phase behaviour. The difference of neutron cross sections between RRa-P3HT and PCBM, and the use of deuteration technique, offer a unique opportunity to probe the miscibility limit of fullerene in the amorphous polymer-rich phase and to tune the contrast between the polymer and the fullerene phases, respectively. Therefore, the proposed approach should be universal and relevant to study new non-fullerene acceptors that are closely related - in terms of chemical structures - to the polymer, where other conventional imaging and spectroscopic techniques present a poor contrast between the blend components.


title: Searches for new physics at SND@LHC

abstract: SND@LHC is an approved experiment equipped to detect scattering of neutrinos produced in the far-forward direction at the LHC, and aimed to measure their properties. In addition, the detector has a potential to search for new feebly interacting particles (FIPs) that may be produced in proton-proton collisions. In this paper, we discuss FIPs signatures at SND@LHC considering two classes of particles: stable FIPs that may be detected via their scattering, and unstable FIPs that decay inside the detector. We estimate the sensitivity of SND@LHC to probe scattering of leptophobic dark matter, and to detect decays of neutrino, scalar, and vector portal particles. Finally, we also compare and qualitatively analyze the potential of SND@LHC and FASER/FASER{\nu} experiments for these searches.


title: Controlling Pivoting Gait using Graph Model Predictive Control

abstract: Pivoting gait is efficient for manipulating a big and heavy object with relatively small manipulating force, in which a robot iteratively tilts the object, rotates it around the vertex, and then puts it down to the floor. However, pivoting gait can easily fail even with a small external disturbance due to its instability in nature. To cope with this problem, we propose a controller to robustly control the object motion during the pivoting gait by introducing two gait modes, i.e., one is the double-support mode, which can manipulate a relatively light object with faster speed, and the other is the quadruple-support mode, which can manipulate a relatively heavy object with lower speed. To control the pivoting gait, a graph model predictive control is applied taking into account of these two gait modes. By adaptively switching the gait mode according to the applied external disturbance, a robot can stably perform the pivoting gait even if the external disturbance is applied to the object.


title: Constraints on the time variation of the speed of light using Strong lensing

abstract: Due to the recent growth of discoveries of strong gravitational lensing (SGL) systems, one can statistically study both lens properties and cosmological parameters from 161 galactic scale SGL systems. We analyze meVSL model with the velocity dispersion of lenses by adopting the redshift and surface mass density depending power-law mass model. Analysis shows that meVSL models with various dark energy models including $\Lambda$CDM, $\omega$CDM, and CPL provide the negative values of meVSL parameter, $b$ when we put the prior to the $\Omega_{m 0}$ value from Planck. These indicate the faster speed of light and the stronger gravitational force in the past. However, if we adopt the WMAP prior on $\Omega_{m0}$, then we obtain the null results on $b$ within 1-$\sigma$ CL for the different dark energy models.


title: When FastText Pays Attention: Efficient Estimation of Word Representations using Constrained Positional Weighting

abstract: In 2018, Mikolov et al. introduced the positional language model, which has characteristics of attention-based neural machine translation models and which achieved state-of-the-art performance on the intrinsic word analogy task. However, the positional model is not practically fast and it has never been evaluated on qualitative criteria or extrinsic tasks. We propose a constrained positional model, which adapts the sparse attention mechanism from neural machine translation to improve the speed of the positional model. We evaluate the positional and constrained positional models on three novel qualitative criteria and on language modeling. We show that the positional and constrained positional models contain interpretable information about the grammatical properties of words and outperform other shallow models on language modeling. We also show that our constrained model outperforms the positional model on language modeling and trains twice as fast.


title: Inequivalent quantizations from gradings and ${\mathbb Z}_2\times {\mathbb Z}_2$ parabosons

abstract: This paper introduces the parastatistics induced by ${\mathbb Z}_2\times {\mathbb Z}_2$-graded algebras. It accommodates four kinds of particles: ordinary bosons and three types of parabosons which mutually anticommute when belonging to different type (so far, in the literature, only parastatistics induced by ${\mathbb Z}_2\times {\mathbb Z}_2$-graded superalgebras and producing parafermions have been considered). It is shown how to detect ${\mathbb Z}_2\times {\mathbb Z}_2$-graded parabosons in the multi-particle sector of a quantum model. The difference with respect to a system composed by ordinary bosons is spotted by measuring some selected observables on certain given eigenstates. The construction of the multi-particle states is made through the appropriate braided tensor product. The application of ${\mathbb Z}_2$- and ${\mathbb Z}_2\times {\mathbb Z}_2$- gradings produces $9$ inequivalent multi-particle Hilbert spaces of a $4\times 4$ matrix oscillator. The ${\mathbb Z}_2\times {\mathbb Z}_2$-graded parabosonic Hilbert space is one of them.


title: Demystifying Regular Expression Bugs: A comprehensive study on regular expression bug causes, fixes, and testing

abstract: Regular expressions cause string-related bugs and open security vulnerabilities for DOS attacks. However, beyond ReDoS (Regular expression Denial of Service), little is known about the extent to which regular expression issues affect software development and how these issues are addressed in practice. We conduct an empirical study of 356 merged regex-related pull request bugs from Apache, Mozilla, Facebook, and Google GitHub repositories. We identify and classify the nature of the regular expression problems, the fixes, and the related changes in the test code. The most important findings in this paper are as follows: 1) incorrect regular expression behavior is the dominant root cause of regular expression bugs (165/356, 46.3%). The remaining root causes are incorrect API usage (9.3%) and other code issues that require regular expression changes in the fix (29.5%), 2) fixing regular expression bugs is nontrivial as it takes more time and more lines of code to fix them compared to the general pull requests, 3) most (51%) of the regex-related pull requests do not contain test code changes. Certain regex bug types (e.g., compile error, performance issues, regex representation) are less likely to include test code changes than others, and 4) the dominant type of test code changes in regex-related pull requests is test case addition (75%). The results of this study contribute to a broader understanding of the practical problems faced by developers when using, fixing, and testing regular expressions.


title: Efficient pre-training objectives for Transformers

abstract: The Transformer architecture deeply changed the natural language processing, outperforming all previous state-of-the-art models. However, well-known Transformer models like BERT, RoBERTa, and GPT-2 require a huge compute budget to create a high quality contextualised representation. In this paper, we study several efficient pre-training objectives for Transformers-based models. By testing these objectives on different tasks, we determine which of the ELECTRA model's new features is the most relevant. We confirm that Transformers pre-training is improved when the input does not contain masked tokens and that the usage of the whole output to compute the loss reduces training time. Moreover, inspired by ELECTRA, we study a model composed of two blocks; a discriminator and a simple generator based on a statistical model with no impact on the computational performances. Besides, we prove that eliminating the MASK token and considering the whole output during the loss computation are essential choices to improve performance. Furthermore, we show that it is possible to efficiently train BERT-like models using a discriminative approach as in ELECTRA but without a complex generator, which is expensive. Finally, we show that ELECTRA benefits heavily from a state-of-the-art hyper-parameters search.


title: Sharpness of Seeger-Sogge-Stein orders for the weak (1,1) boundedness of Fourier integral operators

abstract: Let $X$ and $Y$ be two smooth manifolds of the same dimension. It was proved by Seeger, Sogge and Stein in \cite{SSS} that the Fourier integral operators with real non-degenerate phase functions in the class $I^{\mu}_1(X,Y;\Lambda),$ $\mu\leq -(n-1)/2,$ are bounded from $H^1$ to $L^1.$ The sharpness of the order $-(n-1)/2,$ for any elliptic operator was also proved in \cite{SSS} and extended to other types of canonical relations in \cite{Ruzhansky1999}. That the operators in the class $I^{\mu}_1(X,Y;\Lambda),$ $\mu\leq -(n-1)/2,$ satisfy the weak (1,1) inequality was proved by Tao \cite{Tao:weak11}. In this note, we prove that the weak (1,1) inequality for the order $ -(n-1)/2$ is sharp for any elliptic Fourier integral operator, as well as its versions for canonical relations satisfying additional rank conditions.


title: X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answering

abstract: Multilingual models, such as M-BERT and XLM-R, have gained increasing popularity, due to their zero-shot cross-lingual transfer learning capabilities. However, their generalization ability is still inconsistent for typologically diverse languages and across different benchmarks. Recently, meta-learning has garnered attention as a promising technique for enhancing transfer learning under low-resource scenarios: particularly for cross-lingual transfer in Natural Language Understanding (NLU). In this work, we propose X-METRA-ADA, a cross-lingual MEta-TRAnsfer learning ADAptation approach for NLU. Our approach adapts MAML, an optimization-based meta-learning approach, to learn to adapt to new languages. We extensively evaluate our framework on two challenging cross-lingual NLU tasks: multilingual task-oriented dialog and typologically diverse question answering. We show that our approach outperforms naive fine-tuning, reaching competitive performance on both tasks for most languages. Our analysis reveals that X-METRA-ADA can leverage limited data for faster adaptation.


title: Introducing the Partitioned Equivalence Test: Artificial Intelligence in Automatic Passenger Counting Validation

abstract: Automatic passenger counting (APC) in public transport has been introduced in the 1970s and has been rapidly emerging in recent years. APC systems, like all other measurement devices, are susceptible to error, which is treated as random noise and is required to not exceed certain bounds. The demand for very low errors is especially fueld by applications like revenue sharing, which is in the billions, annually. As a result, both the requirements as well as the costs heavily increased. In this work, we address the latter problem and present a solution to increase the efficiency of initial or recurrent (e.g. yearly or more frequent) APC validation. Our new approach, the partitioned equivalence test, is an extension to this widely used statistic hypothesis test and guarantees the same bounded, low user risk while reducing effort. This can be used to either cut costs or to extend validation without cost increase. It involves a pre-classification step, which itsself can be arbitrary, so we evaluated several use cases: entirely manual and algorithmic, artificial intelligence assisted workflows. For former, by restructuring the evaluation of manual counts, our new statistical test can be used as a drop-in replacement for existing test procedures. The largest savings, however, result from latter algorithmic use cases: Due to the user risk being as bounded as in the original equivalence test, no additional requirements are introduced. Algorithms are allowed to be failable and thus, our test does not require the availability of general artificial intelligence. All in all, automatic passenger counting as well as the equivalence test itself can both benefit from our new extension.


title: A genus explanation of the Buchsbaum-Rim multiplicity

abstract: We study the Buchsbaum-Rim multiplicity, ab inicio, through a Koszul-\v{C}ech spectral sequence. We show that the Buchsbaum-Rim multiplicity is the arithmetic genus (Euler characteristic) of Koszul homology sheaves on a projective space over the base scheme.


title: Domain adaptation based self-correction model for COVID-19 infection segmentation in CT images

abstract: The capability of generalization to unseen domains is crucial for deep learning models when considering real-world scenarios. However, current available medical image datasets, such as those for COVID-19 CT images, have large variations of infections and domain shift problems. To address this issue, we propose a prior knowledge driven domain adaptation and a dual-domain enhanced self-correction learning scheme. Based on the novel learning schemes, a domain adaptation based self-correction model (DASC-Net) is proposed for COVID-19 infection segmentation on CT images. DASC-Net consists of a novel attention and feature domain enhanced domain adaptation model (AFD-DA) to solve the domain shifts and a self-correction learning process to refine segmentation results. The innovations in AFD-DA include an image-level activation feature extractor with attention to lung abnormalities and a multi-level discrimination module for hierarchical feature domain alignment. The proposed self-correction learning process adaptively aggregates the learned model and corresponding pseudo labels for the propagation of aligned source and target domain information to alleviate the overfitting to noises caused by pseudo labels. Extensive experiments over three publicly available COVID-19 CT datasets demonstrate that DASC-Net consistently outperforms state-of-the-art segmentation, domain shift, and coronavirus infection segmentation methods. Ablation analysis further shows the effectiveness of the major components in our model. The DASC-Net enriches the theory of domain adaptation and self-correction learning in medical imaging and can be generalized to multi-site COVID-19 infection segmentation on CT images for clinical deployment.