title: A simplified nonsmooth nonconvex bundle method with applications to security-constrained ACOPF problems

abstract: An optimization algorithm for a group of nonsmooth nonconvex problems inspired by two-stage stochastic programming problems is proposed. The main challenges for these problems include (1) the problems lack the popular lower-type properties such as prox-regularity assumed in many nonsmooth nonconvex optimization algorithms, (2) the objective can not be analytically expressed and (3) the evaluation of function values and subgradients are computationally expensive. To address these challenges, this report first examines the properties that exist in many two-stage problems, specifically upper-C^2 objectives. Then, we show that quadratic penalty method for security-constrained alternating current optimal power flow (SCACOPF) contingency problems can make the contingency solution functions upper-C^2 . Based on these observations, a simplified bundle algorithm that bears similarity to sequential quadratic programming (SQP) method is proposed. It is more efficient in implementation and computation compared to conventional bundle methods. Global convergence analysis of the algorithm is presented under novel and reasonable assumptions. The proposed algorithm therefore fills the gap of theoretical convergence for some smoothed SCACOPF problems. The inconsistency that might arise in our treatment of the constraints are addressed through a penalty algorithm whose convergence analysis is also provided. Finally, theoretical capabilities and numerical performance of the algorithm are demonstrated through numerical examples.


title: Distance bounds for generalized bicycle codes

abstract: Generalized bicycle (GB) codes is a class of quantum error-correcting codes constructed from a pair of binary circulant matrices. Unlike for other simple quantum code ans\"atze, unrestricted GB codes may have linear distance scaling. In addition, low-density parity-check GB codes have a naturally overcomplete set of low-weight stabilizer generators, which is expected to improve their performance in the presence of syndrome measurement errors. For such GB codes with a given maximum generator weight $w$, we constructed upper distance bounds by mapping them to codes local in $D\le w-1$ dimensions, and lower existence bounds which give $d\ge {\cal O}({n}^{1/2})$. We have also done an exhaustive enumeration of GB codes for certain prime circulant sizes in a family of two-qubit encoding codes with row weights 4, 6, and 8; the observed distance scaling is consistent with $A(w){n}^{1/2}+B(w)$, where $n$ is the code length and $A(w)$ is increasing with $w$.


title: On the probability-quality paradox in language generation

abstract: When generating natural language from neural probabilistic models, high probability does not always coincide with high quality: It has often been observed that mode-seeking decoding methods, i.e., those that produce high-probability text under the model, lead to unnatural language. On the other hand, the lower-probability text generated by stochastic methods is perceived as more human-like. In this note, we offer an explanation for this phenomenon by analyzing language generation through an information-theoretic lens. Specifically, we posit that human-like language should contain an amount of information (quantified as negative log-probability) that is close to the entropy of the distribution over natural strings. Further, we posit that language with substantially more (or less) information is undesirable. We provide preliminary empirical evidence in favor of this hypothesis; quality ratings of both human and machine-generated text -- covering multiple tasks and common decoding strategies -- suggest high-quality text has an information content significantly closer to the entropy than we would expect by chance.


title: Improved Relation Networks for End-to-End Speaker Verification and Identification

abstract: Speaker identification systems in a real-world scenario are tasked to identify a speaker amongst a set of enrolled speakers given just a few samples for each enrolled speaker. This paper demonstrates the effectiveness of meta-learning and relation networks for this use case. We propose improved relation networks for speaker verification and few-shot (unseen) speaker identification. The use of relation networks facilitates joint training of the frontend speaker encoder and the backend model. Inspired by the use of prototypical networks in speaker verification and to increase the discriminability of the speaker embeddings, we train the model to classify samples in the current episode amongst all speakers present in the training set. Furthermore, we propose a new training regime for faster model convergence by extracting more information from a given meta-learning episode with negligible extra computation. We evaluate the proposed techniques on VoxCeleb, SITW and VCTK datasets on the tasks of speaker verification and unseen speaker identification. The proposed approach outperforms the existing approaches consistently on both tasks.


title: SimVQA: Exploring Simulated Environments for Visual Question Answering

abstract: Existing work on VQA explores data augmentation to achieve better generalization by perturbing the images in the dataset or modifying the existing questions and answers. While these methods exhibit good performance, the diversity of the questions and answers are constrained by the available image set. In this work we explore using synthetic computer-generated data to fully control the visual and language space, allowing us to provide more diverse scenarios. We quantify the effect of synthetic data in real-world VQA benchmarks and to which extent it produces results that generalize to real data. By exploiting 3D and physics simulation platforms, we provide a pipeline to generate synthetic data to expand and replace type-specific questions and answers without risking the exposure of sensitive or personal data that might be present in real images. We offer a comprehensive analysis while expanding existing hyper-realistic datasets to be used for VQA. We also propose Feature Swapping (F-SWAP) -- where we randomly switch object-level features during training to make a VQA model more domain invariant. We show that F-SWAP is effective for enhancing a currently existing VQA dataset of real images without compromising on the accuracy to answer existing questions in the dataset.


title: Units of twisted group rings and their correlations to classical group rings

abstract: This paper is centered around the classical problem of extracting properties of a finite group $G$ from the ring isomorphism class of its integral group ring $\mathbb{Z} G$. This problem is considered via describing the unit group $\mathcal{U}( \mathbb{Z} G)$ generically for a finite group. Since the $90's$ several well known generic constructions of units are known to generate a subgroup of finite index in $\mathcal{U}(\mathbb{Z } G)$ if $\mathbb{Q} G$ does not have so-called exceptional simple epimorphic images, e.g. $M_2 (\mathbb{Q})$. However it remained a major open problem to find a {\it generic} construction under the presence of the latter type of simple images. In this article we obtain such generic construction of units. Moreover, this new construction also exhibits new properties, such as providing generically free subgroups of large rank. As an application we answer positively for several classes of groups recent conjectures on the rank and the periodic elements of the abelianisation $\mathcal{U}(\mathbb{Z} G)^{ab}$. To obtain all this, we investigate the group ring $R \Gamma$ of an extension $\Gamma$ of some normal subgroup $N$ by a group $G$, over a domain $R$. More precisely, we obtain a direct sum decomposition of the (twisted) group algebra of $\Gamma$ over the fraction field $F$ of $R$ in terms of various twisted group rings of $G$ over finite extensions of $F$. Furthermore, concrete information on the kernel and cokernel of the associated projections is obtained. Along the way we also launch the investigations of the unit group of twisted group rings and of $\mathcal{U}( R\Gamma)$ via twisted group rings.


title: Singularity formation in the incompressible Euler equation in finite and infinite time

abstract: Some classical and recent results on the Euler equations governing perfect (incompressible and inviscid) fluid motion are collected and reviewed, with some small novelties scattered throughout. The perspective and emphasis will be given through the lens of infinite-dimensional dynamical systems, and various open problems are listed and discussed.


title: Search for Coincident Gravitational-wave and Fast Radio Burst Events from 4-OGC and the First CHIME/FRB Catalog

abstract: Advanced LIGO and Virgo have reported 90 confident gravitational-wave (GW) observations from compact-binary coalescences from their three observation runs. In addition, numerous subthreshold gravitational-wave candidates have been identified. Binary neutron star (BNS) mergers can produce gravitational waves and short-gamma ray bursts, as confirmed by GW170817/GRB 170817A. There may be electromagnetic counterparts recorded in archival observations associated with subthreshold gravitational-wave candidates. The CHIME/FRB Collaboration has reported the first large sample of fast radio bursts (FRBs), millisecond radio transients detected up to cosmological distances; a fraction of these may be associated with BNS mergers. This work searches for coincident gravitational waves and FRBs from BNS mergers using candidates from the fourth-Open Gravitational-wave Catalog (4-OGC) and the first CHIME/FRB catalog. We use a ranking statistic for GW/FRB association which combines the gravitational-wave detection statistic with the odds of temporal and spatial association. We analyze gravitational-wave candidates and non-repeating FRBs from 2019 April 1 to 2019 July 1, when both the Advanced LIGO/Virgo gravitational-wave detectors and the CHIME radio telescope were observing. The most significant coincident candidate has a false alarm rate of 0.29 per observation time, which is consistent with a null observation. The null results imply, at most, $\mathcal{O}(0.01)\%$ - $\mathcal{O}(1)\%$ of FRBs are produced from the BNS mergers.


title: Cosmological Neutrinos

abstract: Within the context of hot big-bang cosmology, a cosmic background of presently low energy neutrinos is predicted to exist in concert with the photons of the cosmic background radiation. The number density of the cosmological neutrinos is of the same order as that of the photons of the cosmic background radiation. That makes neutrinos the second most abundant particle species in the universe. In the early universe, when these neutrinos were highly relativistic, their effects in determining the ultimate structure and evolution of the universe were significant.


title: Gromov-Witten theory via roots and logarithms

abstract: Orbifold and logarithmic structures provide independent routes to the virtual enumeration of curves with tangency orders for a simple normal crossings pair $(X|D)$. The theories do not coincide and their relationship has remained mysterious. We prove that the genus zero orbifold theories of multi-root stacks of strata blowups of $(X|D)$ converge to the corresponding logarithmic theory of $(X|D)$. With fixed numerical data, there is an explicit combinatorial criterion that guarantees when a blowup is sufficiently refined for the theories to coincide. There are two key ideas in the proof. The first is the construction of a naive Gromov-Witten theory, which serves as an intermediary between roots and logarithms. The second is a smoothing theorem for tropical stable maps; the geometric theorem then follows via virtual intersection theory relative to the universal target. The results import new computational tools into logarithmic Gromov-Witten theory. As an application, we show that the genus zero logarithmic Gromov-Witten theory of a pair is determined by the absolute Gromov-Witten theories of its strata.


title: A Baseline Readability Model for Cebuano

abstract: In this study, we developed the first baseline readability model for the Cebuano language. Cebuano is the second most-used native language in the Philippines with about 27.5 million speakers. As the baseline, we extracted traditional or surface-based features, syllable patterns based from Cebuano's documented orthography, and neural embeddings from the multilingual BERT model. Results show that the use of the first two handcrafted linguistic features obtained the best performance trained on an optimized Random Forest model with approximately 87% across all metrics. The feature sets and algorithm used also is similar to previous results in readability assessment for the Filipino language showing potential of crosslingual application. To encourage more work for readability assessment in Philippine languages such as Cebuano, we open-sourced both code and data.


title: A Derivation of Nesterov's Accelerated Gradient Algorithm from Optimal Control Theory

abstract: Nesterov's accelerated gradient algorithm is derived from first principles. The first principles are founded on the recently-developed optimal control theory for optimization. This theory frames an optimization problem as an optimal control problem whose trajectories generate various continuous-time algorithms. The algorithmic trajectories satisfy the necessary conditions for optimal control. The necessary conditions produce a controllable dynamical system for accelerated optimization. Stabilizing this system via a quadratic control Lyapunov function generates an ordinary differential equation. An Euler discretization of the resulting differential equation produces Nesterov's algorithm. In this context, this result solves the purported mystery surrounding the algorithm.


title: Volume of Intersection of a Cone with a Sphere

abstract: The manuscript provides formulas for the volume of a body defined by the intersection of a solid cone and a solid sphere as a function of the sphere radius, of the distance between cone apex and sphere center, and of the cone aperture angle. If the sphere center lies on the (extended) cone axis the analysis may be based on cylinder coordinates fixed at the cone axis, and the volume is the sum of the well-known volumes of finite cones and sphere caps. At the general geometry the sphere center is not on the (extended) cone axis. Our approach calculates the volume by slicing space perpendicular to the cone axis and by integrating the lens areas defined by the sphere-cone intersection. These volume integrals are rephrased with the aid of the Byrd-Friedmann tables to Elliptic Integrals of the First, Second and Third Kind.


title: Exotic Cores with and without Dark-Matter Admixtures in Compact Stars

abstract: We parameterize the core of compact spherical star configurations by a mass ($m_x$) and a radius ($r_x$) and study the resulting admissible areas in the total-mass vs. total-radius plane. The employed fiducial equation-of-state models of the corona at radii $r \ge r_x$ and pressures $p \le p_x = p(r = r_x)$ are that (i) of constant sound velocity and (ii) a proxy of DY$\Delta$ DD-ME2 provided by Buchdahl's exactly solvable ansatz. The core ($r < r_x$) may contain any type of material, e.g. Standard-Model matter with unspecified equation of state or/and an unspecified Dark-Matter admixture. Employing a toy model for the cool equation of state with first-order phase transition we discuss also the mass-radius relation of compact stars with an admixture of Dark Matter in a Mirror-World scenario.


title: Group decision making with q-rung orthopair hesitant fuzzy preference relations

abstract: This paper mainly studies group decision making (GDM) problem based on q-rung orthopair hesitant fuzzy preference relations (q-ROHFPRs). First, the definitions of q-ROHFPR and additive consistent q-ROHFPR are introduced. The consistency index of q-ROHFPR is used to judge whether the matrix of q-ROHFPR is acceptable. For the q-ROHFPR matrix that does not meet the acceptable consistency, two optimization models are established for deriving the acceptably additive consistent q-ROHFPRs. In order to make the q-ROHFPR matrix of decision makers still satisfy the consistency after aggregation, this paper extends the q-rung orthopair hesitant fuzzy weighted geometric average operator (q-ROHFWGA). At the same time, in order to verify whether decision makers can reach consensus after aggregation, a consensus index based on distance is offered. Based on this consensus index, an optimization model that satisfies consistency and consensus is constructed to solve the priority vector, and develop a consistency and consensus-based approach for dealing with group decision-making (GDM) with q-ROHFPRs. Finally, the case in this paper verifies the validity and accuracy of the group decision-making model, and also verifies that the q-ROHFPR consistency and consensus management model proposed in this paper can solve the q-rung orthopair hesitant fuzzy preference group decision-making problem.


title: Multi-source data processing and fusion method for power distribution internet of things based on edge intelligence

abstract: With the rapid advancement of the Energy Internet strategy, the number of sensors within the Power Distribution Internet of Things (PD-IoT) has increased dramatically. In this paper, an edge intelligence-based PD-IoT multi-source data processing and fusion method is proposed to solve the problems of confusing storage and insufficient fusion computing performance of multi-source heterogeneous distribution data. First, a PD-IoT multi-source data processing and fusion architecture based on edge smart terminals is designed. Second, to realize the uniform conversion of various sensor data sources in the distribution network in terms of magnitude and order of magnitude. By introducing the Box-Cox transform to improve the data offset problem in the Zscore normalization process, a multi-source heterogeneous data processing method for distribution networks based on the Box-Cox transform Zscore is proposed. Then, the conflicting phenomena of DS inference methods in data source fusion are optimally handled based on the PCA algorithm. A multi-source data fusion model based on DS inference with conflict optimization is constructed to ensure the effective fusion of distribution data sources from different domains. Finally, the effectiveness of the proposed method is verified by an experimental analysis of an IEEE39 node system in a regional distribution network in China.


title: Progressive approximation of bound states by finite series of square-integrable functions

abstract: We use the "tridiagonal representation approach" to solve the time-independent Schr\"odinger equation for bound states in a basis set of finite size. We obtain two classes of solutions written as finite series of square integrable functions that support a tridiagonal matrix representation of the wave operator. The differential wave equation becomes an algebraic three-term recursion relation for the expansion coefficients of the series, which is solved in terms of finite polynomials in the energy and/or potential parameters. These orthogonal polynomials contain all physical information about the system. The basis elements in configuration space are written in terms of either the Romanovski-Bessel polynomial or the Romanovski-Jacobi polynomial. The maximum degree of both polynomials is limited by the polynomial parameter(s). This makes the size of the basis set finite but sufficient to give a very good approximation of the bound states wavefunctions that improves with an increase in the basis size.


title: Performative Power

abstract: We introduce the notion of performative power, which measures the ability of a firm operating an algorithmic system, such as a digital content recommendation platform, to cause change in a population of participants. We relate performative power to the economic study of competition in digital economies. Traditional economic concepts struggle with identifying anti-competitive patterns in digital platforms not least due to the complexity of market definition. In contrast, performative power is a causal notion that is identifiable with minimal knowledge of the market, its internals, participants, products, or prices. Low performative power implies that a firm can do no better than to optimize their objective on current data. In contrast, firms of high performative power stand to benefit from steering the population towards more profitable behavior. We confirm in a simple theoretical model that monopolies maximize performative power. A firm's ability to personalize increases performative power, while competition and outside options decrease performative power. On the empirical side, we propose an observational causal design to identify performative power from discontinuities in how digital platforms display content. This allows to repurpose causal effects from various studies about digital platforms as lower bounds on performative power. Finally, we speculate about the role that performative power might play in competition policy and antitrust enforcement in digital marketplaces.


title: Hall field-induced magneto-oscillations near charge neutrality point in graphene

abstract: We explore the non-equilibrium transport regime in graphene using a large dc current in combination with a perpendicular magnetic field. The strong in-plane Hall field that is generated in the bulk of the graphene channel results in Landau levels that are tilted spatially. The energy of cyclotron orbits in the bulk varies as a function of the spatial position of the guiding center, enabling us to observe a series of compelling features. While Shubnikov-de Haas oscillations are predictably suppressed in the presence of the Hall field, a set of fresh magnetoresistance oscillations emerge near the charge neutrality point as a function of dc current. Two branches of oscillations with linear dispersions are evident as we vary carrier density and dc current, the velocity of which closely resembles the TA and LA phonon modes, suggestive of phonon-assisted intra-Landau level transitions between adjacent cyclotron orbits. Our results offer unique possibilities to explore non-equilibrium phenomena in two-dimensional materials and van der Waals heterostructures.


title: Templates for 3D Object Pose Estimation Revisited: Generalization to New Objects and Robustness to Occlusions

abstract: We present a method that can recognize new objects and estimate their 3D pose in RGB images even under partial occlusions. Our method requires neither a training phase on these objects nor real images depicting them, only their CAD models. It relies on a small set of training objects to learn local object representations, which allow us to locally match the input image to a set of "templates", rendered images of the CAD models for the new objects. In contrast with the state-of-the-art methods, the new objects on which our method is applied can be very different from the training objects. As a result, we are the first to show generalization without retraining on the LINEMOD and Occlusion-LINEMOD datasets. Our analysis of the failure modes of previous template-based approaches further confirms the benefits of local features for template matching. We outperform the state-of-the-art template matching methods on the LINEMOD, Occlusion-LINEMOD and T-LESS datasets. Our source code and data are publicly available at https://github.com/nv-nguyen/template-pose


title: Quantum Computing with $\mathbb{Z}_2$ Abelian anyon system

abstract: Topological quantum computers provide a fault-tolerant method for performing quantum computation. Topological quantum computers manipulate topological defects with exotic exchange statistics called anyons. The simplest anyon model for universal topological quantum computation is the Fibonacci anyon model, which is a non-abelian anyon system. In non-abelian anyon systems, exchanging anyons always results a unitary operations instead of a simple phase changing in abelian anyon systems. So, non-abelian anyon systems are of the interest to topological quantum computation. Up till now, most people still hold the belief that topological quantum computions can be implemented only on the non-abelian anyon systems. But actually this is not true. Inspired by extrinsic semiconductor technology, we suggest that abelian anyon systems with defects also support topological quantum computing. In this letter, we report a topological quantum computer prototype based on $\mathbb{Z}_2$ abelian anyon system.


title: Mamba: a systematic software solution for beamline experiments at HEPS

abstract: To cater for the diverse experiment requirements at the High Energy Photon Source (HEPS) with often limited human resources, Bluesky is chosen as the basis for our software framework, Mamba. In our attempt to address Bluesky's lack of integrated GUIs, command injection with feedback is chosen as the main way for the GUIs to cooperate with the CLI; a RPC service is provided, which also covers functionalities unsuitable for command injection, as well as pushing of status updates. In order to fully support high-frequency applications like fly scans, Bluesky's support for asynchronous control is being improved; to support high-throughput experiments, Mamba Data Worker (MDW) is being developed to cover the complexity in asynchronous online data processing for these experiments. To systematically simplify the specification of metadata, scan parameters and data-processing graphs for each type of experiments, an experiment parameter generator (EPG) will be developed; experiment-specific modules to automate preparation steps will also be made. The integration of off-the-shelf code in Mamba for domain-specific needs is under investigation, and Mamba GUI Studio (MGS) is being developed to simplify the implementation and integration of GUIs.


title: Statistical description of galaxy clusters in Finzi model of gravity

abstract: We exploit a new theory of gravity proposed by Finzi, which gives stronger interaction at large scales, to study the thermodynamic description of galaxy clusters. We employ a statistical model to deduce various thermodynamics equations of state. In addition, we analyze the behavior of clustering parameter in comparison to its standard (Newtonian) counterpart. The general distribution function and its behavior with varying strength of clustering parameter are also studied. The possibility of phase transition is investigated and it is observed that a phase transition is possible though hierarchically. We also analyze the model by comparing the results with data available through SDSS-III, and obtain the parameters involved.


title: Covariance Recovery for One-Bit Sampled Data With Time-Varying Sampling Thresholds-Part II: Non-Stationary Signals

abstract: The recovery of the input signal covariance values from its one-bit sampled counterpart has been deemed a challenging task in the literature. To deal with its difficulties, some assumptions are typically made to find a relation between the input covariance matrix and the autocorrelation values of the one-bit sampled data. This includes the arcsine law and the modified arcsine law that were discussed in Part I of this work [2]. We showed that by facilitating the deployment of time-varying thresholds, the modified arcsine law has a promising performance in covariance recovery. However, the modified arcsine law also assumes input signals are stationary, which is typically a simplifying assumption for real-world applications. In fact, in many signal processing applications, the input signals are readily known to be non-stationary with a non-Toeplitz covariance matrix. In this paper, we propose an approach to extending the arcsine law to the case where one-bit ADCs apply time-varying thresholds while dealing with input signals that originate from a non-stationary process. In particular, the recovery methods are shown to accurately recover the time-varying variance and autocorrelation values. Furthermore, we extend the formulation of the Bussgang law to the case where non-stationary input signals are considered.


title: Cite-seeing and Reviewing: A Study on Citation Bias in Peer Review

abstract: Citations play an important role in researchers' careers as a key factor in evaluation of scientific impact. Many anecdotes advice authors to exploit this fact and cite prospective reviewers to try obtaining a more positive evaluation for their submission. In this work, we investigate if such a citation bias actually exists: Does the citation of a reviewer's own work in a submission cause them to be positively biased towards the submission? In conjunction with the review process of two flagship conferences in machine learning and algorithmic economics, we execute an observational study to test for citation bias in peer review. In our analysis, we carefully account for various confounding factors such as paper quality and reviewer expertise, and apply different modeling techniques to alleviate concerns regarding the model mismatch. Overall, our analysis involves 1,314 papers and 1,717 reviewers and detects citation bias in both venues we consider. In terms of the effect size, by citing a reviewer's work, a submission has a non-trivial chance of getting a higher score from the reviewer: an expected increase in the score is approximately 0.23 on a 5-point Likert item. For reference, a one-point increase of a score by a single reviewer improves the position of a submission by 11% on average.


title: ImpDet: Exploring Implicit Fields for 3D Object Detection

abstract: Conventional 3D object detection approaches concentrate on bounding boxes representation learning with several parameters, i.e., localization, dimension, and orientation. Despite its popularity and universality, such a straightforward paradigm is sensitive to slight numerical deviations, especially in localization. By exploiting the property that point clouds are naturally captured on the surface of objects along with accurate location and intensity information, we introduce a new perspective that views bounding box regression as an implicit function. This leads to our proposed framework, termed Implicit Detection or ImpDet, which leverages implicit field learning for 3D object detection. Our ImpDet assigns specific values to points in different local 3D spaces, thereby high-quality boundaries can be generated by classifying points inside or outside the boundary. To solve the problem of sparsity on the object surface, we further present a simple yet efficient virtual sampling strategy to not only fill the empty region, but also learn rich semantic features to help refine the boundaries. Extensive experimental results on KITTI and Waymo benchmarks demonstrate the effectiveness and robustness of unifying implicit fields into object detection.


title: Bayesian optimization with known experimental and design constraints for chemistry applications

abstract: Optimization strategies driven by machine learning, such as Bayesian optimization, are being explored across experimental sciences as an efficient alternative to traditional design of experiment. When combined with automated laboratory hardware and high-performance computing, these strategies enable next-generation platforms for autonomous experimentation. However, the practical application of these approaches is hampered by a lack of flexible software and algorithms tailored to the unique requirements of chemical research. One such aspect is the pervasive presence of constraints in the experimental conditions when optimizing chemical processes or protocols, and in the chemical space that is accessible when designing functional molecules or materials. Although many of these constraints are known a priori, they can be interdependent, non-linear, and result in non-compact optimization domains. In this work, we extend our experiment planning algorithms Phoenics and Gryffin such that they can handle arbitrary known constraints via an intuitive and flexible interface. We benchmark these extended algorithms on continuous and discrete test functions with a diverse set of constraints, demonstrating their flexibility and robustness. In addition, we illustrate their practical utility in two simulated chemical research scenarios: the optimization of the synthesis of o-xylenyl Buckminsterfullerene adducts under constrained flow conditions, and the design of redox active molecules for flow batteries under synthetic accessibility constraints. The tools developed constitute a simple, yet versatile strategy to enable model-based optimization with known experimental constraints, contributing to its applicability as a core component of autonomous platforms for scientific discovery.


title: Automatic Detection of Expressed Emotion from Five-Minute Speech Samples: Challenges and Opportunities

abstract: We present a novel feasibility study on the automatic recognition of Expressed Emotion (EE), a family environment concept based on caregivers speaking freely about their relative/family member. We describe an automated approach for determining the \textit{degree of warmth}, a key component of EE, from acoustic and text features acquired from a sample of 37 recorded interviews. These recordings, collected over 20 years ago, are derived from a nationally representative birth cohort of 2,232 British twin children and were manually coded for EE. We outline the core steps of extracting usable information from recordings with highly variable audio quality and assess the efficacy of four machine learning approaches trained with different combinations of acoustic and text features. Despite the challenges of working with this legacy data, we demonstrated that the degree of warmth can be predicted with an $F_{1}$-score of \textbf{61.5\%}. In this paper, we summarise our learning and provide recommendations for future work using real-world speech samples.


title: Effect of nonfactorizable background geometry on thermodynamics of clustering of galaxies

abstract: We study the effect of nonfactorizable background geometry on the thermodynamics of the clustering of galaxies. A canonical partition function is derived for the gravitating system of galaxies treated as point particles contained in cells of appropriate dimensions. Various thermodynamic equations of state, like Helmholtz free energy and entropy, among others, are also obtained. We also estimate the effect of the corrected Newton law on the distribution function of galaxies. Remarkably, the effect of the modified Newton law is seen only in the clustering parameter while the standard structure of the equations is preserved. A comparison of the modified clustering parameter with that of the original clustering parameter is made to visualize the effect of the correction on the time scale of clustering. The possibility of system symmetry breaking is also analyzed by investigating the behavior of the specific heat with increasing system temperature.


title: Strategies for reducing frequency scatter in large arrays of superconducting resonators

abstract: Superconducting resonators are now found in a broad range of applications that require high-fidelity measurement of low-energy signals. A common feature across almost all of these applications is the need for increased numbers of resonators to further improve sensitivity, and the ability to read out large numbers of resonators without the need for additional cryogenic complexity is a primary motivation. One of the major limitations of current resonator arrays is the observed scatter in the resonator frequencies when compared to the initial design. Here we present recent progress toward identifying one of the dominant underlying causes of resonator scatter, inductor line width fluctuation. We designed and fabricated an array of lumped-element resonators with inductor line width changing from 1.8um to 2.2um in step of 0.1um defined with electron-beam lithography to probe and quantify the systematic variation of resonance frequency across a 6-inch wafer. The resonators showed a linear frequency shift of 20MHz (140FWHM) and 30MHz (214FWHM), respectively, as they are connected to two different capacitors. This linear relationship matches our theoretical prediction. The widely used MLA photon lithography facility for MKID fabrication has a resolution on the order of 600nm, which could cause frequency fluctuation on the order of 100MHz or 710FWHM.


title: Random cubic planar graphs converge to the Brownian sphere

abstract: In this paper, the scaling limit of random connected cubic planar graphs (respectively multigraphs) is shown to be the Brownian sphere. The proof consists in essentially two main steps. First, thanks to the known decomposition of cubic planar graphs into their 3-connected components, the metric structure of a random cubic planar graph is shown to be well approximated by its unique 3-connected component of linear size, with modified distances. Then, Whitney's theorem ensures that a 3-connected cubic planar graph is the dual of a simple triangulation, for which it is known that the scaling limit is the Brownian sphere. Curien and Le Gall have recently developed a framework to study the modification of distances in general triangulations and in their dual. By extending this framework to simple triangulations, it is shown that 3-connected cubic planar graphs with modified distances converge jointly with their dual triangulation to the Brownian sphere.


title: Origin of spin reorientation and intrinsic anomalous Hall effect in the kagome ferrimagnet TbMn6Sn6

abstract: TbMn$_6$Sn$_6$ has attracted a lot of recent interest for a variety of reasons, most importantly, because of the hypothesis that it may support quantum-limit Chern topological magnetism, derived from the kagome geometry. Besides, TbMn$_6$Sn$_6$ features a highly unusual magnetic reorientation transition about 100 K below the Curie point, whereby all spins in the system, remaining collinear, rotate by 90$^\circ$. In this work, we address both issues combining experiment, mean-field theory and first-principle calculations. Both magnetic reorientation and the unusual temperature dependence of the anomalous Hall conductivity (AHC) find quantitative explanation in the fact that Mn and Tb, by virtue of the Mermin-Wagner theorem, have very different spin dynamics, with Tb spins experiencing much more rapid fluctuation. We were able to cleanly extract the intrinsic AHC from our experiment, and calculated the same microscopically, with good semiquantitative agreement. We have identified the points in the band structure responsible for the AHC and showed that they are not the kagome-derived Dirac points at the K-corner of the Brillouin zone, as conjectured previously.


title: VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers

abstract: Breakthroughs in transformer-based models have revolutionized not only the NLP field, but also vision and multimodal systems. However, although visualization and interpretability tools have become available for NLP models, internal mechanisms of vision and multimodal transformers remain largely opaque. With the success of these transformers, it is increasingly critical to understand their inner workings, as unraveling these black-boxes will lead to more capable and trustworthy models. To contribute to this quest, we propose VL-InterpreT, which provides novel interactive visualizations for interpreting the attentions and hidden representations in multimodal transformers. VL-InterpreT is a task agnostic and integrated tool that (1) tracks a variety of statistics in attention heads throughout all layers for both vision and language components, (2) visualizes cross-modal and intra-modal attentions through easily readable heatmaps, and (3) plots the hidden representations of vision and language tokens as they pass through the transformer layers. In this paper, we demonstrate the functionalities of VL-InterpreT through the analysis of KD-VLP, an end-to-end pretraining vision-language multimodal transformer-based model, in the tasks of Visual Commonsense Reasoning (VCR) and WebQA, two visual question answering benchmarks. Furthermore, we also present a few interesting findings about multimodal transformer behaviors that were learned through our tool.


title: Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo

abstract: Contrastive learning (CL) is widely known to require many negative samples, 65536 in MoCo for instance, for which the performance of a dictionary-free framework is often inferior because the negative sample size (NSS) is limited by its mini-batch size (MBS). To decouple the NSS from the MBS, a dynamic dictionary has been adopted in a large volume of CL frameworks, among which arguably the most popular one is MoCo family. In essence, MoCo adopts a momentum-based queue dictionary, for which we perform a fine-grained analysis of its size and consistency. We point out that InfoNCE loss used in MoCo implicitly attract anchors to their corresponding positive sample with various strength of penalties and identify such inter-anchor hardness-awareness property as a major reason for the necessity of a large dictionary. Our findings motivate us to simplify MoCo v2 via the removal of its dictionary as well as momentum. Based on an InfoNCE with the proposed dual temperature, our simplified frameworks, SimMoCo and SimCo, outperform MoCo v2 by a visible margin. Moreover, our work bridges the gap between CL and non-CL frameworks, contributing to a more unified understanding of these two mainstream frameworks in SSL. Code is available at: https://bit.ly/3LkQbaT.


title: Universalizing Analog Quantum Simulators

abstract: Unitary Sampling Expectation-Value Reconstruction (USER) is used to determine expectation values that are not directly accessible on an analog quantum simulator.


title: Generation and Simulation of Synthetic Datasets with Copulas

abstract: This paper proposes a new method to generate synthetic data sets based on copula models. Our goal is to produce surrogate data resembling real data in terms of marginal and joint distributions. We present a complete and reliable algorithm for generating a synthetic data set comprising numeric or categorical variables. Applying our methodology to two datasets shows better performance compared to other methods such as SMOTE and autoencoders.


title: Continuous Scene Representations for Embodied AI

abstract: We propose Continuous Scene Representations (CSR), a scene representation constructed by an embodied agent navigating within a space, where objects and their relationships are modeled by continuous valued embeddings. Our method captures feature relationships between objects, composes them into a graph structure on-the-fly, and situates an embodied agent within the representation. Our key insight is to embed pair-wise relationships between objects in a latent space. This allows for a richer representation compared to discrete relations (e.g., [support], [next-to]) commonly used for building scene representations. CSR can track objects as the agent moves in a scene, update the representation accordingly, and detect changes in room configurations. Using CSR, we outperform state-of-the-art approaches for the challenging downstream task of visual room rearrangement, without any task specific training. Moreover, we show the learned embeddings capture salient spatial details of the scene and show applicability to real world data. A summery video and code is available at https://prior.allenai.org/projects/csr.


title: Quantum simulation beyond Hamiltonian paradigm: categorical quantum simulation

abstract: With the development of topological field theory, the mathematical tool of the tensor category was also introduced into physics. Traditional group theory corresponds to a special category,group category. Tensor categories can describe higher-order interactions and symmetric relations, while group theory can only describe first-order interactions. In fact, the quantum circuit itself constitutes a category. However, at present, the field of quantum computing mainly uses group theory as a mathematical tool. If category theory is introduced into the field of quantum simulation, the application scope of quantum computers can be greatly expanded. This paper propose a new dynamic simulation method,categorical quantum simulation. In our paradigm quantum simulation is no longer based on the structure of the group theory, but based on the structure of the tensor category. This could enable many systems that could not be efficiently quantum simulated before.In this article we give an concrete example of the categorical simulation of $SU(3)$ Yang-Mills theory. It shows that categorical quantum simulation provides a new encoding method,emergenism encoding, which saves more qubits resources than reductionism quantum encoding. In addition, many domains can be described in the language of category theory, which allows quantum circuits to directly encode and simulate these domains.


title: PLCverif: Status of a Formal Verification Tool for Programmable Logic Controller

abstract: Programmable Logic Controllers (PLC) are widely used for industrial automation including safety systems at CERN. The incorrect behaviour of the PLC control system logic can cause significant financial losses by damage of property or the environment or even injuries in some cases, therefore ensuring their correct behaviour is essential. While testing has been for many years the traditional way of validating the PLC control system logic, CERN developed a model checking platform to go one step further and formally verify PLC logic. This platform, called PLCverif, first released internally for CERN usage in 2019, is now available to anyone since September 2020 via an open source licence. In this paper, we will first give an overview of the PLCverif platform capabilities before focusing on the improvements done since 2019 such as the larger support coverage of the Siemens PLC programming languages, the better support of the C Bounded Model Checker backend (CBMC) and the process of releasing PLCverif as an open-source software.


title: Entanglement Negativity and Mutual Information after a Quantum Quench: Exact Link from Space-Time Duality

abstract: We study the growth of entanglement between two adjacent regions in a tripartite, one-dimensional many-body system after a quantum quench. Combining a replica trick with a space-time duality transformation, we derive an exact, universal relation between the entanglement negativity and Renyi-1/2 mutual information which holds at times shorter than the sizes of all subsystems. Our proof is directly applicable to any translationally invariant local quantum circuit, i.e., any lattice system in discrete time characterised by local interactions, irrespective of the nature of its dynamics. Our derivation indicates that such a relation can be directly extended to any system where information spreads with a finite maximal velocity.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: A Cognitive Architecture for Machine Consciousness and Artificial Superintelligence: Thought Is Structured by the Iterative Updating of Working Memory

abstract: This article provides an analytical framework for how to simulate human-like thought processes within a computer. It describes how attention and memory should be structured, updated, and utilized to search for associative additions to the stream of thought. The focus is on replicating the dynamics of the mammalian working memory system, which features two forms of persistent activity: sustained firing (preserving information on the order of seconds) and synaptic potentiation (preserving information from minutes to hours). The article uses a series of over 40 original figures to systematically demonstrate how the iterative updating of these working memory stores provides functional structure to behavior, cognition, and consciousness. In an AI implementation, these two memory stores should be updated continuously and in an iterative fashion, meaning each state should preserve a proportion of the coactive representations from the state before it. Thus, the set of concepts in working memory will evolve gradually and incrementally over time. This makes each state a revised iteration of the preceding state and causes successive states to overlap and blend with respect to the information they contain. Transitions between states happen as persistent activity spreads activation energy throughout the hierarchical network searching long-term memory for the most appropriate representation to be added to the global workspace. The result is a chain of associatively linked intermediate states capable of advancing toward a solution or goal. Iterative updating is conceptualized here as an information processing strategy, a model of working memory, a theory of consciousness, and an algorithm for designing and programming artificial general intelligence.


title: LEAD1.0: A Large-scale Annotated Dataset for Energy Anomaly Detection in Commercial Buildings

abstract: Modern buildings are densely equipped with smart energy meters, which periodically generate a massive amount of time-series data yielding few million data points every day. This data can be leveraged to discover the underlying loads, infer their energy consumption patterns, inter-dependencies on environmental factors, and the building's operational properties. Furthermore, it allows us to simultaneously identify anomalies present in the electricity consumption profiles, which is a big step towards saving energy and achieving global sustainability. However, to date, the lack of large-scale annotated energy consumption datasets hinders the ongoing research in anomaly detection. We contribute to this effort by releasing a well-annotated version of a publicly available ASHRAE Great Energy Predictor III data set containing 1,413 smart electricity meter time series spanning over one year. In addition, we benchmark the performance of eight state-of-the-art anomaly detection methods on our dataset and compare their performance.


title: Rethinking Video Salient Object Ranking

abstract: Salient Object Ranking (SOR) involves ranking the degree of saliency of multiple salient objects in an input image. Most recently, a method is proposed for ranking salient objects in an input video based on a predicted fixation map. It relies solely on the density of the fixations within the salient objects to infer their saliency ranks, which is incompatible with human perception of saliency ranking. In this work, we propose to explicitly learn the spatial and temporal relations between different salient objects to produce the saliency ranks. To this end, we propose an end-to-end method for video salient object ranking (VSOR), with two novel modules: an intra-frame adaptive relation (IAR) module to learn the spatial relation among the salient objects in the same frame locally and globally, and an inter-frame dynamic relation (IDR) module to model the temporal relation of saliency across different frames. In addition, to address the limited video types (just sports and movies) and scene diversity in the existing VSOR dataset, we propose a new dataset that covers different video types and diverse scenes on a large scale. Experimental results demonstrate that our method outperforms state-of-the-art methods in relevant fields. We will make the source code and our proposed dataset available.


title: More is Different: Non-Minimal Dark Sectors and their Implications for Particle Physics, Astrophysics, and Cosmology -- 13 Take-Away Lessons for Snowmass 2021

abstract: The phrase "more is different" is often used to refer to the new, unexpected collective phenomena that can arise when the number of states in a given system is large. In this contribution to the Snowmass 2021 Study, we describe 13 unexpected collective phenomena that can arise when the dark sector contains a large number of states, contrary to the usual assumptions. These 13 take-away lessons stretch across all of the domains of relevance for dark-matter physics, including collider signatures, direct-detection signatures, indirect-detection signatures, new perspectives on dark-matter complementarity, and even unexpected astrophysical and cosmological phenomena that transcend those normally associated with single-component dark-matter scenarios. These lessons -- and the phenomena on which they are based -- thereby illustrate the need to maintain a broad perspective when contemplating the possible signatures and theoretical possibilities associated with non-minimal dark sectors.


title: To ArXiv or not to ArXiv: A Study Quantifying Pros and Cons of Posting Preprints Online

abstract: Double-blind conferences have engaged in debates over whether to allow authors to post their papers online on arXiv or elsewhere during the review process. Independently, some authors of research papers face the dilemma of whether to put their papers on arXiv due to its pros and cons. We conduct a study to substantiate this debate and dilemma via quantitative measurements. Specifically, we conducted surveys of reviewers in two top-tier double-blind computer science conferences -- ICML 2021 (5361 submissions and 4699 reviewers) and EC 2021 (498 submissions and 190 reviewers). Our two main findings are as follows. First, more than a third of the reviewers self-report searching online for a paper they are assigned to review. Second, outside the review process, we find that preprints from better-ranked affiliations see a weakly higher visibility, with a correlation of 0.06 in ICML and 0.05 in EC. In particular, papers associated with the top-10-ranked affiliations had a visibility of approximately 11% in ICML and 22% in EC, whereas the remaining papers had a visibility of 7% and 18% respectively.


title: Generating High Fidelity Data from Low-density Regions using Diffusion Models

abstract: Our work focuses on addressing sample deficiency from low-density regions of data manifold in common image datasets. We leverage diffusion process based generative models to synthesize novel images from low-density regions. We observe that uniform sampling from diffusion models predominantly samples from high-density regions of the data manifold. Therefore, we modify the sampling process to guide it towards low-density regions while simultaneously maintaining the fidelity of synthetic data. We rigorously demonstrate that our process successfully generates novel high fidelity samples from low-density regions. We further examine generated samples and show that the model does not memorize low-density data and indeed learns to generate novel samples from low-density regions.


title: R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis

abstract: Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires querying the NeRF network hundreds of times. To resolve it, existing efforts mainly attempt to reduce the number of required sampled points. However, the problem of iterative sampling still exists. On the other hand, Neural Light Field (NeLF) presents a more straightforward representation over NeRF in novel view synthesis -- the rendering of a pixel amounts to one single forward pass without ray-marching. In this work, we present a deep residual MLP network (88 layers) to effectively learn the light field. We show the key to successfully learning such a deep NeLF network is to have sufficient data, for which we transfer the knowledge from a pre-trained NeRF model via data distillation. Extensive experiments on both synthetic and real-world scenes show the merits of our method over other counterpart algorithms. On the synthetic scenes, we achieve 26-35x FLOPs reduction (per camera ray) and 28-31x runtime speedup, meanwhile delivering significantly better (1.4-2.8 dB average PSNR improvement) rendering quality than NeRF without any customized parallelism requirement.


title: Length L-function for Network-Constrained Point Data

abstract: Network constrained points are referred to as points restricted to road networks, such as taxi pick up and drop off locations. A significant pattern of network constrained points is referred to as an aggregation; e.g., the aggregation of pick up points may indicate a high taxi demand in a particular area. Although the network K function using the shortest path network distance has been proposed to detect point aggregation, its statistical unit is still radius based. R neighborhood, in particular, has inconsistent network length owing to the complex configuration of road networks which cause unfair counts and identification errors in networks (e.g., the length of the r neighborhood located at an intersection is longer than that on straight roads, which may include more points). In this study, we derived the length L function for network constrained points to identify the aggregation by designing a novel neighborhood as the statistical unit; the total length of this is consistent throughout the network. Compared to the network K function, our method can detect a true to life aggregation scale, identify the aggregation with higher network density, as well as identify the aggregations that the network K function cannot. We validated our method using taxi trips pick up location data within Zhongguancun Area in Beijing, analyzing differences in maximal aggregation between workdays and weekends to understand taxi demand in the morning and evening peak.


title: Audio-Visual Speech Codecs: Rethinking Audio-Visual Speech Enhancement by Re-Synthesis

abstract: Since facial actions such as lip movements contain significant information about speech content, it is not surprising that audio-visual speech enhancement methods are more accurate than their audio-only counterparts. Yet, state-of-the-art approaches still struggle to generate clean, realistic speech without noise artifacts and unnatural distortions in challenging acoustic environments. In this paper, we propose a novel audio-visual speech enhancement framework for high-fidelity telecommunications in AR/VR. Our approach leverages audio-visual speech cues to generate the codes of a neural speech codec, enabling efficient synthesis of clean, realistic speech from noisy signals. Given the importance of speaker-specific cues in speech, we focus on developing personalized models that work well for individual speakers. We demonstrate the efficacy of our approach on a new audio-visual speech dataset collected in an unconstrained, large vocabulary setting, as well as existing audio-visual datasets, outperforming speech enhancement baselines on both quantitative metrics and human evaluation studies. Please see the supplemental video for qualitative results at https://github.com/facebookresearch/facestar/releases/download/paper_materials/video.mp4.


title: Growth of R\'enyi Entropies in Interacting Integrable Models and the Breakdown of the Quasiparticle Picture

abstract: R\'enyi entropies are conceptually valuable and experimentally relevant generalisations of the celebrated von Neumann entanglement entropy. After a quantum quench in a clean quantum many-body system they generically display a universal linear growth in time followed by saturation. While a finite subsystem is essentially at local equilibrium when the entanglement saturates, it is genuinely out-of-equilibrium in the growth phase. In particular, the slope of the growth carries vital information on the nature of the system's dynamics, and its characterisation is a key objective of current research. Here we show that the slope of R\'enyi entropies can be determined by means of a spacetime duality transformation. In essence, we argue that the slope coincides with the stationary density of entropy of the model obtained by exchanging the roles of space and time. Therefore, very surprisingly, the slope of the entanglement is expressed as an equilibrium quantity. We use this observation to find an explicit exact formula for the slope of R\'enyi entropies in all integrable models treatable by thermodynamic Bethe ansatz and evolving from integrable initial states. Interestingly, this formula can be understood in terms of a quasiparticle picture only in the von Neumann limit.


title: A 23 MW data centre is all you need

abstract: The field of machine learning has achieved striking progress in recent years, witnessing breakthrough results on language modelling, protein folding and nitpickingly fine-grained dog breed classification. Some even succeeded at playing computer games and board games, a feat both of engineering and of setting their employers' expectations. The central contribution of this work is to carefully examine whether this progress, and technology more broadly, can be expected to continue indefinitely. Through a rigorous application of statistical theory and failure to extrapolate beyond the training data, we answer firmly in the negative and provide details: technology will peak at 3:07 am (BST) on 20th July, 2032. We then explore the implications of this finding, discovering that individuals awake at this ungodly hour with access to a sufficiently powerful computer possess an opportunity for myriad forms of long-term linguistic 'lock in'. All we need is a large (>> 1W) data centre to seize this pivotal moment. By setting our analogue alarm clocks, we propose a tractable algorithm to ensure that, for the future of humanity, the British spelling of colour becomes the default spelling across more than 80% of the global word processing software market.


title: TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing

abstract: Recent advances like StyleGAN have promoted the growth of controllable facial editing. To address its core challenge of attribute decoupling in a single latent space, attempts have been made to adopt dual-space GAN for better disentanglement of style and content representations. Nonetheless, these methods are still incompetent to obtain plausible editing results with high controllability, especially for complicated attributes. In this study, we highlight the importance of interaction in a dual-space GAN for more controllable editing. We propose TransEditor, a novel Transformer-based framework to enhance such interaction. Besides, we develop a new dual-space editing and inversion strategy to provide additional editing flexibility. Extensive experiments demonstrate the superiority of the proposed framework in image quality and editing capability, suggesting the effectiveness of TransEditor for highly controllable facial editing.


title: Variational Quantum Pulse Learning

abstract: Quantum computing is among the most promising emerging techniques to solve problems that are computationally intractable on classical hardware. A large body of existing works focus on using variational quantum algorithms on the gate level for machine learning tasks, such as the variational quantum circuit (VQC). However, VQC has limited flexibility and expressibility due to limited number of parameters, e.g. only one parameter can be trained in one rotation gate. On the other hand, we observe that quantum pulses are lower than quantum gates in the stack of quantum computing and offers more control parameters. Inspired by the promising performance of VQC, in this paper we propose variational quantum pulses (VQP), a novel paradigm to directly train quantum pulses for learning tasks. The proposed method manipulates variational quantum pulses by pulling and pushing the amplitudes of pulses in an optimization framework. Similar to variational quantum algorithms, our framework to train pulses maintains the robustness to noise on Noisy Intermediate-Scale Quantum (NISQ) computers. In an example task of binary classification, VQP learning achieves up to 11% and 9% higher accuracy compared with VQC learning on the qiskit noise simulators (with noise model from real machine) and ibmq-jarkata, respectively, demonstrating its effectiveness and feasibility. Stability for VQP to obtain reliable results has also been verified in the presence of noise.


title: On the simplicity of the tensor product of two simple modules of quantum affine algebras

abstract: Lapid and M\'{i}nguez gave a criterion of the irreducibility of the parabolic induction $\sigma \times \pi$, where $\sigma$ is a ladder representation and $\pi$ is an arbitrary irreducible representation of the general linear group over a non-archimedean field. Through quantum affine Schur-Weyl duality, when $k$ is large enough, this gives a criterion of the irreducibility of the tensor product of a snake module $L(M)$ and any simple module $L(N)$ of the quantum affine algebra $U_q(\widehat{\mathfrak{sl}_k})$. The goal of this paper is to add conditions to their criterion such that it works for any $k \geq 1$. We prove the criterion in the case where both modules are snake modules or one of them is a fundamental module at an extremity node and the other is any simple module. We also defined a similar criterion in the Grassmannian cluster algebra $\mathbb{C}[\mathrm{Gr}(k,n, \sim)]$, and show that for any $k \geq 1$, two ladders are compatible if and only if the corresponding tableaux satisfy the criterion. This generalizes Leclerc and Zelevinsky's result that two Pl\"{u}cker coordinates are compatible if and only if they are weakly separated.


title: A Closer Look at Rehearsal-Free Continual Learning

abstract: Continual learning is a setting where machine learning models learn novel concepts from continuously shifting training data, while simultaneously avoiding degradation of knowledge on previously seen classes which may disappear from the training data for extended periods of time (a phenomenon known as the catastrophic forgetting problem). Current approaches for continual learning of a single expanding task (aka class-incremental continual learning) require extensive rehearsal of previously seen data to avoid this degradation of knowledge. Unfortunately, rehearsal comes at a cost to memory, and it may also violate data-privacy. Instead, we explore combining knowledge distillation and parameter regularization in new ways to achieve strong continual learning performance without rehearsal. Specifically, we take a deep dive into common continual learning techniques: prediction distillation, feature distillation, L2 parameter regularization, and EWC parameter regularization. We first disprove the common assumption that parameter regularization techniques fail for rehearsal-free continual learning of a single, expanding task. Next, we explore how to leverage knowledge from a pre-trained model in rehearsal-free continual learning and find that vanilla L2 parameter regularization outperforms EWC parameter regularization and feature distillation. Finally, we explore the recently popular ImageNet-R benchmark, and show that L2 parameter regularization implemented in self-attention blocks of a ViT transformer outperforms recent popular prompting for continual learning methods.


title: BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers

abstract: 3D visual perception tasks, including 3D detection and map segmentation based on multi-camera images, are essential for autonomous driving systems. In this work, we present a new framework termed BEVFormer, which learns unified BEV representations with spatiotemporal transformers to support multiple autonomous driving perception tasks. In a nutshell, BEVFormer exploits both spatial and temporal information by interacting with spatial and temporal space through predefined grid-shaped BEV queries. To aggregate spatial information, we design spatial cross-attention that each BEV query extracts the spatial features from the regions of interest across camera views. For temporal information, we propose temporal self-attention to recurrently fuse the history BEV information. Our approach achieves the new state-of-the-art 56.9\% in terms of NDS metric on the nuScenes \texttt{test} set, which is 9.0 points higher than previous best arts and on par with the performance of LiDAR-based baselines. We further show that BEVFormer remarkably improves the accuracy of velocity estimation and recall of objects under low visibility conditions. The code is available at \url{https://github.com/zhiqi-li/BEVFormer}.


title: Do Vision-Language Pretrained Models Learn Composable Primitive Concepts?

abstract: Vision-language (VL) pretrained models have achieved impressive performance on multimodal reasoning and zero-shot recognition tasks. Many of these VL models are pretrained on unlabeled image and caption pairs from the internet. In this paper, we study whether representations of primitive concepts--such as colors, shapes, or the attributes of object parts--emerge automatically within these pretrained VL models. We propose a two-step framework, Compositional Concept Mapping (CompMap), to investigate this. CompMap first asks a VL model to generate primitive concept activations with text prompts, and then learns to construct a composition model that maps the primitive concept activations (e.g. the likelihood of black tail or red wing) to composite concepts (e.g. a red-winged blackbird). We show that a composition model can be reliably learn from ground truth primitive concepts. We thus hypothesize that if primitive concepts indeed emerge in a VL pretrained model, its primitive concept activations can be used to learn a composition model similar to the one designed by experts. We propose a quantitative metric to measure the degree of similarity, and refer to the metric as the interpretability metric. We also measure the classification accuracy when using the primitive concept activations and the learned composition model to predict the composite concepts, and refer to it as the usefulness metric. Our study reveals that state-of-the-art VL pretrained models learn primitive concepts that are highly useful for fine-grained visual recognition on the CUB dataset, and compositional generalization tasks on the MIT-States dataset. However, we observe that the learned composition models have low interpretability in our qualitative analyses. Our results reveal the limitations of existing VL models, and the necessity of pretraining objectives that encourage the acquisition of primitive concepts.


title: MyStyle: A Personalized Generative Prior

abstract: We introduce MyStyle, a personalized deep generative prior trained with a few shots of an individual. MyStyle allows to reconstruct, enhance and edit images of a specific person, such that the output is faithful to the person's key facial characteristics. Given a small reference set of portrait images of a person (~100), we tune the weights of a pretrained StyleGAN face generator to form a local, low-dimensional, personalized manifold in the latent space. We show that this manifold constitutes a personalized region that spans latent codes associated with diverse portrait images of the individual. Moreover, we demonstrate that we obtain a personalized generative prior, and propose a unified approach to apply it to various ill-posed image enhancement problems, such as inpainting and super-resolution, as well as semantic editing. Using the personalized generative prior we obtain outputs that exhibit high-fidelity to the input images and are also faithful to the key facial characteristics of the individual in the reference set. We demonstrate our method with fair-use images of numerous widely recognizable individuals for whom we have the prior knowledge for a qualitative evaluation of the expected outcome. We evaluate our approach against few-shots baselines and show that our personalized prior, quantitatively and qualitatively, outperforms state-of-the-art alternatives.


title: FindIt: Generalized Localization with Natural Language Queries

abstract: We propose FindIt, a simple and versatile framework that unifies a variety of visual grounding and localization tasks including referring expression comprehension, text-based localization, and object detection. Key to our architecture is an efficient multi-scale fusion module that unifies the disparate localization requirements across the tasks. In addition, we discover that a standard object detector is surprisingly effective in unifying these tasks without a need for task-specific design, losses, or pre-computed detections. Our end-to-end trainable framework responds flexibly and accurately to a wide range of referring expression, localization or detection queries for zero, one, or multiple objects. Jointly trained on these tasks, FindIt outperforms the state of the art on both referring expression and text-based localization, and shows competitive performance on object detection. Finally, FindIt generalizes better to out-of-distribution data and novel categories compared to strong single-task baselines. All of these are accomplished by a single, unified and efficient model. The code will be released.


title: Exploring Visual Prompts for Adapting Large-Scale Models

abstract: We investigate the efficacy of visual prompting to adapt large-scale models in vision. Following the recent approach from prompt tuning and adversarial reprogramming, we learn a single image perturbation such that a frozen model prompted with this perturbation performs a new task. Through comprehensive experiments, we demonstrate that visual prompting is particularly effective for CLIP and robust to distribution shift, achieving performance competitive with standard linear probes. We further analyze properties of the downstream dataset, prompt design, and output transformation in regard to adaptation performance. The surprising effectiveness of visual prompting provides a new perspective on adapting pre-trained models in vision. Code is available at http://hjbahng.github.io/visual_prompting .


title: DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools

abstract: We consider the problem of sequential robotic manipulation of deformable objects using tools. Previous works have shown that differentiable physics simulators provide gradients to the environment state and help trajectory optimization to converge orders of magnitude faster than model-free reinforcement learning algorithms for deformable object manipulation. However, such gradient-based trajectory optimization typically requires access to the full simulator states and can only solve short-horizon, single-skill tasks due to local optima. In this work, we propose a novel framework, named DiffSkill, that uses a differentiable physics simulator for skill abstraction to solve long-horizon deformable object manipulation tasks from sensory observations. In particular, we first obtain short-horizon skills using individual tools from a gradient-based optimizer, using the full state information in a differentiable simulator; we then learn a neural skill abstractor from the demonstration trajectories which takes RGBD images as input. Finally, we plan over the skills by finding the intermediate goals and then solve long-horizon tasks. We show the advantages of our method in a new set of sequential deformable object manipulation tasks compared to previous reinforcement learning algorithms and compared to the trajectory optimizer.


title: Bringing Old Films Back to Life

abstract: We present a learning-based framework, recurrent transformer network (RTN), to restore heavily degraded old films. Instead of performing frame-wise restoration, our method is based on the hidden knowledge learned from adjacent frames that contain abundant information about the occlusion, which is beneficial to restore challenging artifacts of each frame while ensuring temporal coherency. Moreover, contrasting the representation of the current frame and the hidden knowledge makes it possible to infer the scratch position in an unsupervised manner, and such defect localization generalizes well to real-world degradations. To better resolve mixed degradation and compensate for the flow estimation error during frame alignment, we propose to leverage more expressive transformer blocks for spatial restoration. Experiments on both synthetic dataset and real-world old films demonstrate the significant superiority of the proposed RTN over existing solutions. In addition, the same framework can effectively propagate the color from keyframes to the whole video, ultimately yielding compelling restored films. The implementation and model will be released at https://github.com/raywzy/Bringing-Old-Films-Back-to-Life.


title: The Mu3e Experiment

abstract: The Mu3e experiment at the Paul Scherrer Institut will search for the lepton-number-violating decay \mueee, extending the sensitivity by four orders of magnitude compared to existing limits. This probe of new physics is complementary to the existing collider, dark matter and neutrino particle physics programmes, and part of a global programme investigating the charged lepton flavour sector. As well as the main \mueee search, Mu3e will also extend the sensitivity to low-mass dark photons, and additional flavour-violating decays involving long-lived or stable particles.


title: Moosinesq Convection in the Cores of Moosive Stars

abstract: Stars with masses $\gtrsim 4 \times 10^{27}M_{\rm{moose}} \approx 1.1 M_\odot$ have core convection zones during their time on the main sequence. In these moosive stars, convection introduces many uncertainties in stellar modeling. In this Letter, we build upon the Boussinesq approximation to present the first-ever simulations of Moosinesq convection, which captures the complex geometric structure of the convection zones of these stars. These flows are bounded in a manner informed by the majestic terrestrial Alces alces (moose) and could have important consequences for the evolution of these stars. We find that Moosinesq convection results in very interesting flow morphologies and rapid heat transfer, and posit this as a mechanism of biomechanical thermoregulation.


title: Ball 3D Localization From A Single Calibrated Image

abstract: Ball 3D localization in team sports has various applications including automatic offside detection in soccer, or shot release localization in basketball. Today, this task is either resolved by using expensive multi-views setups, or by restricting the analysis to ballistic trajectories. In this work, we propose to address the task on a single image from a calibrated monocular camera by estimating ball diameter in pixels and use the knowledge of real ball diameter in meters. This approach is suitable for any game situation where the ball is (even partly) visible. To achieve this, we use a small neural network trained on image patches around candidates generated by a conventional ball detector. Besides predicting ball diameter, our network outputs the confidence of having a ball in the image patch. Validations on 3 basketball datasets reveals that our model gives remarkable predictions on ball 3D localization. In addition, through its confidence output, our model improves the detection rate by filtering the candidates produced by the detector. The contributions of this work are (i) the first model to address 3D ball localization on a single image, (ii) an effective method for ball 3D annotation from single calibrated images, (iii) a high quality 3D ball evaluation dataset annotated from a single viewpoint. In addition, the code to reproduce this research is be made freely available at https://github.com/gabriel-vanzandycke/deepsport.


title: Reproducibility Issues for BERT-based Evaluation Metrics

abstract: Reproducibility is of utmost concern in machine learning and natural language processing (NLP). In the field of natural language generation (especially machine translation), the seminal paper of Post (2018) has pointed out problems of reproducibility of the dominant metric, BLEU, at the time of publication. Nowadays, BERT-based evaluation metrics considerably outperform BLEU. In this paper, we ask whether results and claims from four recent BERT-based metrics can be reproduced. We find that reproduction of claims and results often fails because of (i) heavy undocumented preprocessing involved in the metrics, (ii) missing code and (iii) reporting weaker results for the baseline metrics. (iv) In one case, the problem stems from correlating not to human scores but to a wrong column in the csv file, inflating scores by 5 points. Motivated by the impact of preprocessing, we then conduct a second study where we examine its effects more closely (for one of the metrics). We find that preprocessing can have large effects, especially for highly inflectional languages. In this case, the effect of preprocessing may be larger than the effect of the aggregation mechanism (e.g., greedy alignment vs. Word Mover Distance).


title: Graph-based Active Learning for Semi-supervised Classification of SAR Data

abstract: We present a novel method for classification of Synthetic Aperture Radar (SAR) data by combining ideas from graph-based learning and neural network methods within an active learning framework. Graph-based methods in machine learning are based on a similarity graph constructed from the data. When the data consists of raw images composed of scenes, extraneous information can make the classification task more difficult. In recent years, neural network methods have been shown to provide a promising framework for extracting patterns from SAR images. These methods, however, require ample training data to avoid overfitting. At the same time, such training data are often unavailable for applications of interest, such as automatic target recognition (ATR) and SAR data. We use a Convolutional Neural Network Variational Autoencoder (CNNVAE) to embed SAR data into a feature space, and then construct a similarity graph from the embedded data and apply graph-based semi-supervised learning techniques. The CNNVAE feature embedding and graph construction requires no labeled data, which reduces overfitting and improves the generalization performance of graph learning at low label rates. Furthermore, the method easily incorporates a human-in-the-loop for active learning in the data-labeling process. We present promising results and compare them to other standard machine learning methods on the Moving and Stationary Target Acquisition and Recognition (MSTAR) dataset for ATR with small amounts of labeled data.


title: Data Sampling Affects the Complexity of Online SGD over Dependent Data

abstract: Conventional machine learning applications typically assume that data samples are independently and identically distributed (i.i.d.). However, practical scenarios often involve a data-generating process that produces highly dependent data samples, which are known to heavily bias the stochastic optimization process and slow down the convergence of learning. In this paper, we conduct a fundamental study on how different stochastic data sampling schemes affect the sample complexity of online stochastic gradient descent (SGD) over highly dependent data. Specifically, with a $\phi$-mixing model of data dependence, we show that online SGD with proper periodic data-subsampling achieves an improved sample complexity over the standard online SGD in the full spectrum of the data dependence level. Interestingly, even subsampling a subset of data samples can accelerate the convergence of online SGD over highly dependent data. Moreover, we show that online SGD with mini-batch sampling can further substantially improve the sample complexity over online SGD with periodic data-subsampling over highly dependent data. Numerical experiments validate our theoretical results.


title: Low-fat diets and testosterone in men: Systematic review and meta-analysis of intervention studies

abstract: Background: Higher endogenous testosterone levels are associated with reduced chronic disease risk and mortality. Since the mid-20th century, there have been significant changes in dietary patterns, and men's testosterone levels have declined in western countries. Cross-sectional studies show inconsistent associations between fat intake and testosterone in men. Methods: Studies eligible for inclusion were intervention studies, with minimal confounding variables, comparing the effect of low-fat vs high-fat diets on men's sex hormones. 9 databases were searched from their inception to October 2020, yielding 6 eligible studies, with a total of 206 participants. Random effects meta-analyses were performed using Cochrane's Review Manager software. Cochrane's risk of bias tool was used for quality assessment. Results: There were significant decreases in sex hormones on low-fat vs high-fat diets. Standardised mean differences with 95% confidence intervals (CI) for outcomes were: total testosterone [-0.38 (95% CI -0.75 to -0.01) P = 0.04]; free testosterone [-0.37 (95% CI -0.63 to -0.11) P = 0.005]; urinary testosterone [-0.38 (CI 95% -0.66 to -0.09) P = 0.009], and dihydrotestosterone [-0.3 (CI 95% -0.56 to -0.03) P = 0.03]. There were no significant differences for luteinising hormone or sex hormone binding globulin. Subgroup analysis for total testosterone, European and American men, showed a stronger effect [-0.52 (95% CI -0.75 to -0.3) P < 0.001]. Conclusions: Low-fat diets appear to decrease testosterone levels in men, but further randomised controlled trials are needed to confirm this effect. Men with European ancestry may experience a greater decrease in testosterone, in response to a low-fat diet.


title: Improving Adversarial Transferability via Neuron Attribution-Based Attacks

abstract: Deep neural networks (DNNs) are known to be vulnerable to adversarial examples. It is thus imperative to devise effective attack algorithms to identify the deficiencies of DNNs beforehand in security-sensitive applications. To efficiently tackle the black-box setting where the target model's particulars are unknown, feature-level transfer-based attacks propose to contaminate the intermediate feature outputs of local models, and then directly employ the crafted adversarial samples to attack the target model. Due to the transferability of features, feature-level attacks have shown promise in synthesizing more transferable adversarial samples. However, existing feature-level attacks generally employ inaccurate neuron importance estimations, which deteriorates their transferability. To overcome such pitfalls, in this paper, we propose the Neuron Attribution-based Attack (NAA), which conducts feature-level attacks with more accurate neuron importance estimations. Specifically, we first completely attribute a model's output to each neuron in a middle layer. We then derive an approximation scheme of neuron attribution to tremendously reduce the computation overhead. Finally, we weight neurons based on their attribution results and launch feature-level attacks. Extensive experiments confirm the superiority of our approach to the state-of-the-art benchmarks.


title: On products of symmetries in von Neumann algebras

abstract: Let $\mathscr{R}$ be a type $II_1$ von Neumann algebra. We show that every unitary in $\mathscr{R}$ may be decomposed as the product of six symmetries (that is, self-adjoint unitaries) in $\mathscr{R}$, and every unitary in $\mathscr{R}$ with finite spectrum may be decomposed as the product of four symmetries in $\mathscr{R}$. Consequently, the set of products of four symmetries in $\mathscr{R}$ is norm-dense in the unitary group of $\mathscr{R}$. Furthermore, we show that the set of products of three symmetries in a von Neumann algebra $\mathscr{M}$ is not norm-dense in the unitary group of $\mathscr{M}$. This strengthens a result of Halmos-Kakutani which asserts that the set of products of three symmetries in $\mathcal{B}(\mathscr{H})$, the ring of bounded operators on a Hilbert space $\mathscr{H}$, is not the full unitary group of $\mathcal{B}(\mathscr{H})$.


title: Transition edge sensor based detector: from X-ray to $\gamma$-ray

abstract: The Transition Edge Sensor is extremely sensitive to the change of temperature, combined with the high-Z metal of a certain thickness, it can realize the high energy resolution measurement of particles such as X-rays. X-rays with energies below 10 keV have very weak penetrating ability, so only a few microns thick of gold or bismuth can obtain quantum efficiency higher than 70\%. Therefore, the entire structure of the TES X-ray detector in this energy range can be realized in the microfabrication process. However, for X-rays or gamma rays from 10 keV to 200 keV, sub-millimeter absorber layers are required, which cannot be realized by microfabrication process. This paper first briefly introduces a set of TES X-ray detectors and their auxiliary systems built by ShanghaiTech University, then focus on the introduction of the TES $\gamma$-ray detector, with absorber based on an sub-millimeter lead-tin alloy sphere. The detector has a quantum efficiency above 70\% near 100 keV, and an energy resolution of about 161.5eV@59.5keV.


title: Leveraging Privacy Profiles to Empower Users in the Digital Society

abstract: Privacy and ethics of citizens are at the core of the concerns raised by our increasingly digital society. Profiling users is standard practice for software applications triggering the need for users, also enforced by laws, to properly manage privacy settings. Users need to manage software privacy settings properly to protect personally identifiable information and express personal ethical preferences. AI technologies that empower users to interact with the digital world by reflecting their personal ethical preferences can be key enablers of a trustworthy digital society. We focus on the privacy dimension and contribute a step in the above direction through an empirical study on an existing dataset collected from the fitness domain. We find out which set of questions is appropriate to differentiate users according to their preferences. The results reveal that a compact set of semantic-driven questions (about domain-independent privacy preferences) helps distinguish users better than a complex domain-dependent one. This confirms the study's hypothesis that moral attitudes are the relevant piece of information to collect. Based on the outcome, we implement a recommender system to provide users with suitable recommendations related to privacy choices. We then show that the proposed recommender system provides relevant settings to users, obtaining high accuracy.


title: Winding Tachyons and Stringy Black Holes

abstract: We study string theory on $\mathbb{R}^d\times \mathbb{S}^1$. For applications to thermodynamics, the circumference of the $\mathbb{S}^1$ is the inverse temperature, $\beta$. We show that for $d=6$, the low energy effective field theory at the inverse Hagedorn temperature, $\beta=\beta_H$, has a one parameter family of normalizable spherically symmetric solutions that break the winding symmetry around the $\mathbb{S}^1$. The resulting backgrounds exhibit an enhanced symmetry, with the symmetry breaking pattern $SU(2)_L\times SU(2)_R\to SU(2)_{\rm diagonal}$. The effective field theory analysis of these backgrounds is reliable for some range of parameters. More generally, they are described by a worldsheet CFT, which corresponds to the free theory on $\mathbb{R}^6\times \mathbb{S}^1$ perturbed by a non-abelian Thirring deformation with an $r$-dependent coupling. We propose that, in a certain scaling limit, string theory in these backgrounds is described by the $SL(2,\mathbb{R})/U(1)$ cigar, and provides a thermodynamic description of weakly coupled highly excited fundamental strings. We also discuss the relation of these backgrounds to Euclidean black holes with near-Hagedorn Hawking temperature, and possible generalizations to other $d$.


title: Quantum spin liquids bootstrapped from Ising criticality in Rydberg arrays

abstract: Arrays of Rydberg atoms constitute a highly tunable, strongly interacting venue for the pursuit of exotic states of matter. We develop a new strategy for accessing a family of fractionalized phases known as quantum spin liquids in two-dimensional Rydberg arrays. We specifically use effective field theory methods to study arrays assembled from Rydberg chains tuned to an Ising phase transition that famously hosts emergent fermions propagating within each chain. This highly entangled starting point allows us to naturally access spin liquids familiar from Kitaev's honeycomb model, albeit from an entirely different framework. In particular, we argue that finite-range repulsive Rydberg interactions, which frustrate nearby symmetry-breaking orders, can enable coherent propagation of emergent fermions between the chains in which they were born. Delocalization of emergent fermions across the full two-dimensional Rydberg array yields a gapless Z2 spin liquid with a single massless Dirac cone. Here, the Rydberg occupation numbers exhibit universal power-law correlations that provide a straightforward experimental diagnostic of this phase. We further show that explicitly breaking symmetries perturbs the gapless spin liquid into gapped, topologically ordered descendants: Breaking lattice symmetries generates toric-code topological order, whereas introducing chirality generates non-Abelian Ising topological order. In the toric-code phase, we analytically construct microscopic incarnations of non-Abelian defects, which can be created and transported by dynamically controlling the atom positions in the array. Our work suggests that appropriately tuned Rydberg arrays provide a cold-atoms counterpart of solid-state 'Kitaev materials' and, more generally, spotlights a new angle for pursuing experimental platforms for Abelian and non-Abelian fractionalization.

categories: cond-mat.str-el cond-mat.quant-gas physics.atom-ph quant-ph


title: Non-integer conformal dimensions for type IIA flux vacua

abstract: We study the conformal dimensions of the would-be dual operators to the stabilized moduli for two non-supersymmetric DGKT vacua. For the first of them, related to the standard SUSY DGKT vacuum by $G_4=-G_4^{\text{SUSY}}$, we obtain integer conformal dimensions. For the second of them, which has a non-zero harmonic component in $G_2$, we obtain both integers and real numbers.


title: Measuring magic on a quantum processor

abstract: Magic states are the resource that allows quantum computers to attain an advantage over classical computers. This resource consists in the deviation from a property called stabilizerness which in turn implies that stabilizer circuits can be efficiently simulated on a classical computer. Without magic, no quantum computer can do anything that a classical computer cannot do. Given the importance of magic for quantum computation, it would be useful to have a method for measuring the amount of magic in a quantum state. In this work, we propose and experimentally demonstrate a protocol for measuring magic based on randomized measurements. Our experiments are carried out on two IBM Quantum Falcon processors. This protocol can provide a characterization of the effectiveness of a quantum hardware in producing states that cannot be effectively simulated on a classical computer. We show how from these measurements one can construct realistic noise models affecting the hardware.


title: The magneto-rotational instability in massive stars

abstract: The interaction between weak magnetic fields and rotation can lead to instabilities that transport angular momentum (AM) and chemical elements affecting the evolution of massive stars. We explore the effects of the magneto-rotational instability (MRI) in massive stars to determine its impact on stellar evolution. We use the GENEC code to simulate the evolution of a 15 $M_\odot$ model at solar metallicity up to the end of oxygen burning. The MRI is computed with different trigger conditions, (depending on the weighting of chemical gradients through an arbitrary but commonly used factor), and with different treatments of meridional circulation as either advective or diffusive. We also compare the MRI with the Tayler-Spruit (TS) dynamo, in models that included both instabilities interacting linearly. The MRI triggers throughout stellar evolution. Its activation is highly sensitive to the treatment of meridional circulation and the existence of chemical gradients. The MRI is very efficient at transporting both matter and AM, leading to noticeable differences in rotation rates and chemical structure, which may be observable in young main sequence stars. While the TS dynamo is the dominant mechanism for transferring AM, the MRI remains relevant in models where both instabilities are included. Extrapolation of our results suggests that models including the MRI tend to develop more compact cores, which likely produce failed explosions and black holes, than models where only the TS dynamo is included (where explosions an neutron stars may be more frequent. The MRI is an important factor in massive star evolution but is very sensitive to the implementation ofother processes in the model. The transport of AM and chemical elements due to the MRI alters the rotation rates and the chemical make-up of the star from the core to the surface, and may change the explodability properties of massive stars.