title: Perturbative QCD predictions in fixed order for cross section ratios

abstract: In the standard approach, predictions of perturbative Quantum Chromodynamics for ratios of cross sections are computed as the ratio of fixed-order predictions for the numerator and the denominator. Beyond the lowest order in the perturbative expansion, the result does, however, not correspond to a fixed-order prediction for the ratio. This article describes how exact fixed-order results for ratios of arbitrary cross sections can be obtained. The general method for computations in any order of the perturbative expansion is derived, and results for next-to-leading order and next-to-next-to-leading order calculations are given. The approach is applied to theory predictions for various multi-jet cross section ratios measured at hadron colliders. The two methods are compared with each other and with the experimental data. Recommendations are made how to obtain improved theory predictions with more realistic uncertainty estimates.


title: Lepton Flavor in Composite Higgs Models

abstract: In this talk, I will present the status of lepton flavor physics in composite Higgs models with partial compositeness in the light of recent data in the lepton sector. I will consider anarchic flavor setups, scenarios with flavor symmetries, and minimal incarnations of the see-saw mechanism that naturally predict non-negligible lepton compositeness. The focus will be on lepton flavor violating processes, dipole moments, and on probes of lepton flavor universality, all providing stringent tests of partial compositeness. The expected size of effects in the different approaches to lepton flavor and the corresponding constraints will be discussed, including "UV complete", effective, and holographic descriptions.


title: Architecting and Visualizing Deep Reinforcement Learning Models

abstract: To meet the growing interest in Deep Reinforcement Learning (DRL), we sought to construct a DRL-driven Atari Pong agent and accompanying visualization tool. Existing approaches do not support the flexibility required to create an interactive exhibit with easily-configurable physics and a human-controlled player. Therefore, we constructed a new Pong game environment, discovered and addressed a number of unique data deficiencies that arise when applying DRL to a new environment, architected and tuned a policy gradient based DRL model, developed a real-time network visualization, and combined these elements into an interactive display to help build intuition and awareness of the mechanics of DRL inference.


title: Indexed Minimum Empirical Divergence for Unimodal Bandits

abstract: We consider a multi-armed bandit problem specified by a set of one-dimensional family exponential distributions endowed with a unimodal structure. We introduce IMED-UB, a algorithm that optimally exploits the unimodal-structure, by adapting to this setting the Indexed Minimum Empirical Divergence (IMED) algorithm introduced by Honda and Takemura [2015]. Owing to our proof technique, we are able to provide a concise finite-time analysis of IMED-UB algorithm. Numerical experiments show that IMED-UB competes with the state-of-the-art algorithms.


title: Target Propagation via Regularized Inversion

abstract: Target Propagation (TP) algorithms compute targets instead of gradients along neural networks and propagate them backward in a way that is similar yet different than gradient back-propagation (BP). The idea was first presented as a perturbative alternative to back-propagation that may achieve greater accuracy in gradient evaluation when training multi-layer neural networks (LeCun et al., 1989). However, TP has remained more of a template algorithm with many variations than a well-identified algorithm. Revisiting insights of LeCun et al., (1989) and more recently of Lee et al. (2015), we present a simple version of target propagation based on regularized inversion of network layers, easily implementable in a differentiable programming framework. We compare its computational complexity to the one of BP and delineate the regimes in which TP can be attractive compared to BP. We show how our TP can be used to train recurrent neural networks with long sequences on various sequence modeling problems. The experimental results underscore the importance of regularization in TP in practice.


title: Altering Facial Expression Based on Textual Emotion

abstract: Faces and their expressions are one of the potent subjects for digital images. Detecting emotions from images is an ancient task in the field of computer vision; however, performing its reverse -- synthesizing facial expressions from images -- is quite new. Such operations of regenerating images with different facial expressions, or altering an existing expression in an image require the Generative Adversarial Network (GAN). In this paper, we aim to change the facial expression in an image using GAN, where the input image with an initial expression (i.e., happy) is altered to a different expression (i.e., disgusted) for the same person. We used StarGAN techniques on a modified version of the MUG dataset to accomplish this objective. Moreover, we extended our work further by remodeling facial expressions in an image indicated by the emotion from a given text. As a result, we applied a Long Short-Term Memory (LSTM) method to extract emotion from the text and forwarded it to our expression-altering module. As a demonstration of our working pipeline, we also create an application prototype of a blog that regenerates the profile picture with different expressions based on the user's textual emotion.


title: Zero-Shot Text-Guided Object Generation with Dream Fields

abstract: We combine neural rendering with multi-modal image and text representations to synthesize diverse 3D objects solely from natural language descriptions. Our method, Dream Fields, can generate the geometry and color of a wide range of objects without 3D supervision. Due to the scarcity of diverse, captioned 3D data, prior methods only generate objects from a handful of categories, such as ShapeNet. Instead, we guide generation with image-text models pre-trained on large datasets of captioned images from the web. Our method optimizes a Neural Radiance Field from many camera views so that rendered images score highly with a target caption according to a pre-trained CLIP model. To improve fidelity and visual quality, we introduce simple geometric priors, including sparsity-inducing transmittance regularization, scene bounds, and new MLP architectures. In experiments, Dream Fields produce realistic, multi-view consistent object geometry and color from a variety of natural language captions.


title: Kronecker Comultiplication of Stable Characters and Restriction From $S_{mn}$ to $S_m \times S_n$

abstract: A family of symmetric functions $\tilde{s}_\lambda$ was introduced in [OZ], and independently in [AS]. The $\tilde{s}_\lambda$ encode many stability properties of representations of symmetric groups (e.g. when multiplied, the structure constants are reduced Kronecker coefficients). We show that the structure constants for the Kronecker comultiplication $\Delta^*$ are multiplicities for the restriction of irreducible representations from $S_{mn}$ to $S_m \times S_n$ (provided $m$ and $n$ are sufficiently large), and use the structure of $\tilde{s}_\lambda$ to demonstrate two-row stability properties of these restriction multiplicities.


title: Local distributional chaos

abstract: In discrete dynamical system $(X, f)$ where $X$ is a topological space and $f \in C(X,X)$, three notions of distributional chaos were defined. They were denoted by $DC1, DC2$ and $DC3$. For interval systems such three notions coincide and they will be denoted by DC-chaos. Generally speaking we have $DC1 \subseteq DC2 \subseteq DC3$-chaos. We wonder if it is possible that chaos can concentrate in some points and develop a local idea of the distributional chaos. Answering to this question, in [12] is introduced the new notion of $DCi$-points for $i = 1,2,3$. Such special points are those in which DC-chaos of different types concentrate. Also in [12] it is proved that if $f$ is continuous interval map with positive topological entropy, then there is at least one DC1-point in the system. In this paper it is proved that in the symbolic space $(\Sigma, \sigma) $ where $\sigma$ is the shift map, every point of $\Sigma$ is a DC1-point. This result is necessary to prove one of the main results of the paper. If $h(f) > 0 $ for an interval system, then it has an uncountable set of DC1-points and moreover the set can be chosen perfect. In greater dimensions than one, we deal with triangular systems on $I^{2}$. In this case the relationship between topological entropy and different cases of distributional chaos is not clearly understood and several different results are possible. In the paper we use an example of $F$ given by Kolyada in [9] to prove that the corresponding two dimensional system $(I^{2}, F)$ has positive topological entropy but without containing DC2-points, proving that there is no concentration of DC2-chaos


title: The 90 and 150 GHz universal focal-plane modules for the Simons Observatory

abstract: The Simons Observatory (SO) is a suite of telescopes located in the Atacama Desert in Chile that will make sensitive measurements of the cosmic microwave background. There are a host of cosmological and astrophysical questions that SO is forecasted to address. The universal focal-plane modules (UFMs) populate the four SO telescope receiver focal planes. There are three varieties of UFMs, each of which contains transition-edge-sensor bolometers observing in two spectral bands between 30 and 290~GHz. We describe the novel mid-frequency UFMs, which target two of the six spectral bands at 90 and 150~GHz and are central to the cosmological goals of SO.


title: Three-dimensional simulations of the jet feedback mechanism in common envelope jets supernova

abstract: We conduct three-dimensional hydrodynamical simulations of common envelope jets supernova (CEJSN) events where we assume that a neutron star (NS) launches jets as it orbits inside the outer zones of a red supergiant (RSG) envelope, and find the negative jet feedback coefficient to be ~0.1-0.2. This coefficient is the factor by which the jets reduce the mass accretion rate onto the NS as they remove mass from the envelope and inflate bubbles (cocoons). Our results suggest that in most CEJSN events the NS-RSG binary system experiences the grazing envelope evolution (GEE) before it enters a full common envelope evolution (CEE). We also find that the jets induce upward and downward flows in the RSG envelope. These flows together with the strong convection of RSG stars might imply that energy transport by convection in CEJSNe is very important. Because of limited numerical resources we do not include in the simulations the gravity of the NS, nor the accretion process, nor the jets launching process, and nor the gravity of the deformed envelope. Future numerical simulations of CEE with a NS/BH companion should include the accretion process onto the NS (and vary the jets' power accordingly), the full gravitational interaction of the NS with the RSG, and energy transport by the strong convection.


title: Opinion dynamics: Public and private

abstract: We study here the dynamics of opinion formation in a society where we take into account of the internally held beliefs and externally expressed opinions of the individuals, which are not necessarily the same at all times. While these two components can influence one another, their difference, both in dynamics and in the steady state, poses interesting scenarios in terms of the transition to consensus in the society and characterizations of such consensus. Here we study this public and private opinion dynamics and the critical behavior of the consensus forming transitions, using a kinetic exchange model.


title: Hessian determinants and averaging operators over surfaces in ${\mathbb R}^3$

abstract: We prove $L^p({\mathbb R}^3)$ to $L^p_s({\mathbb R}^3)$ Sobolev improvement theorems for local averaging operators over real analytic surfaces in ${\mathbb R}^3$. For most such operators, in a sense made precise in the paper, the set of $(p,s)$ for which we prove $L^p({\mathbb R}^3)$ to $L^p_s({\mathbb R}^3)$ boundedness is optimal up to endpoints. Using an interpolation argument in conjunction with these $L^p({\mathbb R}^3)$ to $L^p_s({\mathbb R}^3)$ results we obtain an $L^p({\mathbb R}^3)$ to $L^q({\mathbb R}^3)$ improvement theorem, and the set of exponents $(p,q)$ obtained will also usually be optimal up to endpoints. The advantage the methods of this paper have over those of the author's earlier papers is that the oscillatory integral methods of the earlier papers, closely tied to the Van der Corput lemma, allow one to only prove 1/2 of a derivative of surface measure Fourier transform decay, while the methods of this paper, when combined with appropriate resolution of singularities methods, allow one to go up to the maximum possible 1 derivative. This allows us to prove the stronger sharp up to endpoints results.


title: Hadamard-type inequalities for $k$-positive matrices

abstract: We establish Hadamard-type inequalities for a class of symmetric matrices called $k$-positive matrices for which the $m$-th elementary symmetric functions of their eigenvalues are positive for all $m\leq k$. These matrices arise naturally in the study of $k$-Hessian equations in Partial Differential Equations. For each $k$-positive matrix, we show that the sum of its principal minors of size $k$ is not larger than the $k$-th elementary symmetric function of their diagonal entries. The case $k=n$ corresponds to the classical Hadamard inequality for positive definite matrices. Some consequences are also obtained.


title: On the Gaussian surface area of spectrahedra

abstract: We show that for sufficiently large $n\geq 1$ and $d=C n^{3/4}$ for some universal constant $C>0$, a random spectrahedron with matrices drawn from Gaussian orthogonal ensemble has Gaussian surface area $\Theta(n^{1/8})$ with high probability.


title: Time-Series Estimation from Randomly Time-Warped Observations

abstract: We consider the problem of estimating a signal from its warped observations. Such estimation is commonly performed by altering the observations through some inverse-warping, or solving a computationally demanding optimization formulation. While these may be unavoidable if observations are few, when large amounts of warped observations are available, the cost of running such algorithms can be prohibitive. We consider the scenario where we have many observations, and propose a computationally simple algorithm for estimating the function of interest. We demonstrate the utility of the algorithm on streaming biomedical signals.


title: Unifying information propagation models on networks and influence maximization

abstract: Information propagation on networks is a central theme in social, behavioral, and economic sciences, with important theoretical and practical implications, such as the influence maximization problem for viral marketing. Here, we consider a model that unifies the classical independent cascade models and the linear threshold models, and generalise them by considering continuous variables and allowing feedback in the dynamics. We then formulate its influence maximization as a mixed integer nonlinear programming problem and adopt derivative-free methods. Furthermore, we show that the problem can be exactly solved in the special case of linear dynamics, where the selection criterion is closely related to the Katz centrality, and propose a customized direct search method with local convergence. We then demonstrate the close-to-optimal performance of the customized direct search numerically on both synthetic and real networks.


title: On Vertex Conditions In Elastic Beam Frames: Analysis on Compact Graphs

abstract: We consider three-dimensional elastic frames constructed out of Euler-Bernoulli beams and describe extension of matching conditions by relaxing the vertex-rigidity assumption and the case in which concentrated mass may exists. This generalization is based on coupling an (elastic) energy functional in terms of field's discontinuities at a vertex along with purely geometric terms derived out of first principles. The corresponding differential operator is shown to be self-adjoint. Although for planar frames with a class of rigid-joints the operator decomposes into a direct sum of two operators, this property only holds for a special class of the proposed model. Application of theoretical results is then discussed in details for compact frames embedded in Euclidean spaces with different dimensions. This includes extension of the established results for rigid-joint case on exploiting the symmetry present in a frame and decomposing the operator by restricting it onto reducing subspaces corresponding to irreducible representations of the symmetry group. Derivation of characteristic equation based on the idea of geometric-free local spectral basis and enforcing geometry of the graph into play by an appropriate choice of the coefficient set will be discussed. Finally, we prove the limit conditions in parameter space which results in decomposing of vector-valued beam Hamiltonian to a direct sum of scalar-valued ones.


title: Stable Centres II: Finite Classical Groups

abstract: Farahat and Higman constructed an algebra $\mathrm{FH}$ interpolating the centres of symmetric group algebras $Z(\mathbb{Z}S_n)$ by proving that the structure constants in these rings are "polynomial in $n$". Inspired by a construction of $\mathrm{FH}$ due to Ivanov and Kerov, we prove for $G_n = GL_n, U_n, Sp_{2n}, O_n$, that the structure constants of $Z(\mathbb{Z}G_n(\mathbb{F}_q))$ are "polynomial in $q^n$", allowing us to construct an equivalent of the Farahat-Higman algebra in each case.


title: Multi-segment and Echelle stellar spectra processing issues and how to solve them

abstract: High-quality stellar spectra are in great demand now - they are the most important ingredient in the stellar population synthesis to study galaxies and star clusters. Here we describe the procedures to increase the quality of flux calibration of stellar spectra. We use examples of NIR intermediate-resolution Echelle spectra collected with the Folded InfraRed Echellete (R~6500, Magellan Baade) and high-resolution UV-optical spectra observed with UVES (R~80000, ESO VLT). By using these procedures, we achieved the quality of the global spectrophotometric calibration as good as 1-2%, which fulfills the requirements for the quality of stellar spectra intended to be used in the stellar population synthesis


title: On cohomology of quasitoric manifolds over a vertex cut of a finite product of simplices

abstract: In this paper, we classify the characteristic matrices associated to quasitoric manifolds over a vertex cut of a finite product of simplices. We discuss the integral cohomology rings of these quasitoric manifolds with possibly minimal generators and show several relations among the product of these generators. We classify integral cohomology rings (up to isomorphism as graded rings) of the quasitoric manifolds over the vertex cut of a finite product of simplices.


title: Frustrated Superradiant Phase Transition

abstract: Frustration occurs when a system cannot find a lowest-energy configuration due to conflicting constraints. We show that a frustrated superradiant phase transition occurs when the ground-state superradiance of cavity fields due to local light-matter interactions cannot simultaneously minimize the positive photon hopping energies. We solve the Dicke trimer model on a triangle motif with both negative and positive hopping energies and show that the latter results in a six-fold degenerate ground-state manifold in which the translational symmetry is spontaneously broken. In the frustrated superradiant phase, we find that two sets of diverging time and fluctuation scales coexist, one governed by the mean-field critical exponent and another by a novel critical exponent. The latter is associated with the fluctuation in the difference of local order parameters and gives rise to site-dependent photon number critical exponents, which may serve as an experimental probe for the frustrated superradiant phase. We provide a qualitative explanation for the emergence of unconventional critical scalings and demonstrate that they are generic properties of the frustrated superradiant phase at the hand of a one-dimensional Dicke lattice with an odd number of sites. The mechanism for the frustrated superradiant phase transition discovered here applies to any lattice geometries where the anti-ferromagnetic ordering of neighboring sites are incompatible and therefore our work paves the way towards the exploration of frustrated phases of coupled light and matter.


title: The Pantheon+ Analysis: Improving the Redshifts and Peculiar Velocities of Type Ia Supernovae Used in Cosmological Analyses

abstract: We examine the redshifts of a comprehensive set of published Type Ia supernovae, and provide a combined, improved catalogue with updated redshifts. We improve on the original catalogues by using the most up-to-date heliocentric redshift data available; ensuring all redshifts have uncertainty estimates; using the exact formulae to convert heliocentric redshifts into the Cosmic Microwave Background (CMB) frame; and utilising an improved peculiar velocity model that calculates local motions in redshift-space and more realistically accounts for the external bulk flow at high-redshifts. In total we reviewed 2821 supernova redshifts; 534 are comprised of repeat-observations of the same supernovae and 1764 pass the cosmology sample quality cuts. We found 5 cases of missing or incorrect heliocentric corrections, 44 incorrect or missing supernova coordinates, 230 missing heliocentric or CMB frame redshifts, and 1200 missing redshift uncertainties. Of the 2287 unique Type Ia supernovae in our sample (1594 of which satisfy cosmology-sample cuts) we updated 990 heliocentric redshifts. The absolute corrections range between $10^{-8} \leq \Delta z \leq 0.038$, and RMS$(\Delta z) \sim 3\times 10^{-3}$. The sign of the correction was essentially random, so the mean and median corrections are small: $4\times 10^{-4}$ and $4\times 10^{-6}$ respectively. We examine the impact of these improvements for $H_0$ and the dark energy equation of state $w$ and find that the cosmological results change by $\Delta H_0 = -0.11$ km s$^{-1}$ Mpc$^{-1}$ and $\Delta w = -0.001$, both significantly smaller than previously reported uncertainties for $H_0$ of 1.4 km s$^{-1}$ Mpc$^{-1}$ and $w$ of 0.04 respectively.


title: Unity is Strength: A Formalization of Cross-Domain Maximal Extractable Value

abstract: The multi-chain future is upon us. Modular architectures are coming to maturity across the ecosystem to scale bandwidth and throughput of cryptocurrency. One example of such is the Ethereum modular architecture, with its beacon chain, its execution chain, its Layer 2s, and soon its shards. These can all be thought as separate blockchains, heavily inter-connected with one another, and together forming an ecosystem. In this work, we call each of these interconnected blockchains "domains", and study the manifestation of Maximal Extractable Value (MEV, a generalization of "Miner Extractable Value") across them. In other words, we investigate whether there exists extractable value that depends on the ordering of transactions in two or more domains jointly. We first recall the definitions of Extractable and Maximal Extractable Value, before introducing a definition of Cross-Domain Maximal Extractable Value. We find that Cross-Domain MEV can be used to measure the incentive for transaction sequencers in different domains to collude with one another, and study the scenarios in which there exists such an incentive. We end the work with a list of negative externalities that might arise from cross-domain MEV extraction and lay out several open questions. We note that the formalism in this work is a work in progress, and we hope that it can serve as the basis for formal analysis tools in the style of those presented in Clockwork Finance, as well as for discussion on how to mitigate the upcoming negative externalities of substantial cross-domain MEV.


title: Neural Point Light Fields

abstract: We introduce Neural Point Light Fields that represent scenes implicitly with a light field living on a sparse point cloud. Combining differentiable volume rendering with learned implicit density representations has made it possible to synthesize photo-realistic images for novel views of small scenes. As neural volumetric rendering methods require dense sampling of the underlying functional scene representation, at hundreds of samples along a ray cast through the volume, they are fundamentally limited to small scenes with the same objects projected to hundreds of training views. Promoting sparse point clouds to neural implicit light fields allows us to represent large scenes effectively with only a single radiance evaluation per ray. These point light fields are a function of the ray direction, and local point feature neighborhood, allowing us to interpolate the light field conditioned training images without dense object coverage and parallax. We assess the proposed method for novel view synthesis on large driving scenarios, where we synthesize realistic unseen views that existing implicit approaches fail to represent. We validate that Neural Point Light Fields make it possible to predict videos along unseen trajectories previously only feasible to generate by explicitly modeling the scene.


title: Approximation by tree tensor networks in high dimensions: Sobolev and compositional functions

abstract: This paper is concerned with convergence estimates for fully discrete tree tensor network approximations of high-dimensional functions from several model classes. For functions having standard or mixed Sobolev regularity, new estimates generalizing and refining known results are obtained, based on notions of linear widths of multivariate functions. In the main results of this paper, such techniques are applied to classes of functions with compositional structure, which are known to be particularly suitable for approximation by deep neural networks. As shown here, such functions can also be approximated by tree tensor networks without a curse of dimensionality -- however, subject to certain conditions, in particular on the depth of the underlying tree. In addition, a constructive encoding of compositional functions in tree tensor networks is given.


title: A Hybrid Science-Guided Machine Learning Approach for Modeling and Optimizing Chemical Processes

abstract: This study presents a broad perspective of hybrid process modeling and optimization combining the scientific knowledge and data analytics in bioprocessing and chemical engineering with a science-guided machine learning (SGML) approach. We divide the approach into two major categories. The first refers to the case where a data-based ML model compliments and makes the first-principle science-based model more accurate in prediction, and the second corresponds to the case where scientific knowledge helps make the ML model more scientifically consistent. We present a detailed review of scientific and engineering literature relating to the hybrid SGML approach, and propose a systematic classification of hybrid SGML models. For applying ML to improve science-based models, we present expositions of the sub-categories of direct serial and parallel hybrid modeling and their combinations, inverse modeling, reduced-order modeling, quantifying uncertainty in the process and even discovering governing equations of the process model. For applying scientific principles to improve ML models, we discuss the sub-categories of science-guided design, learning and refinement. For each sub-category, we identify its requirements, advantages and limitations, together with their published and potential areas of applications in bioprocessing and chemical engineering.We also present several examples to illustrate different hybrid SGML methodologies for modeling polymer processes.


title: KPDrop: Improving Absent Keyphrase Generation

abstract: Keyphrase generation is the task of generating phrases (keyphrases) that summarize the main topics of a given document. Keyphrases can be either present or absent from the given document. While the extraction of present keyphrases has received much attention in the past, only recently a stronger focus has been placed on the generation of absent keyphrases. However, generating absent keyphrases is challenging; even the best methods show only a modest degree of success. In this paper, we propose a model-agnostic approach called keyphrase dropout (or KPDrop) to improve absent keyphrase generation. In this approach, we randomly drop present keyphrases from the document and turn them into artificial absent keyphrases during training. We test our approach extensively and show that it consistently improves the absent performance of strong baselines in both supervised and resource-constrained semi-supervised settings.


title: Why Calibration Error is Wrong Given Model Uncertainty: Using Posterior Predictive Checks with Deep Learning

abstract: Within the last few years, there has been a move towards using statistical models in conjunction with neural networks with the end goal of being able to better answer the question, "what do our models know?". From this trend, classical metrics such as Prediction Interval Coverage Probability (PICP) and new metrics such as calibration error have entered the general repertoire of model evaluation in order to gain better insight into how the uncertainty of our model compares to reality. One important component of uncertainty modeling is model uncertainty (epistemic uncertainty), a measurement of what the model does and does not know. However, current evaluation techniques tends to conflate model uncertainty with aleatoric uncertainty (irreducible error), leading to incorrect conclusions. In this paper, using posterior predictive checks, we show how calibration error and its variants are almost always incorrect to use given model uncertainty, and further show how this mistake can lead to trust in bad models and mistrust in good models. Though posterior predictive checks has often been used for in-sample evaluation of Bayesian models, we show it still has an important place in the modern deep learning world.


title: On the stationary distribution of the noisy voter model

abstract: Given a transition matrix $P$ indexed by a finite set $V$ of vertices, the voter model is a discrete-time Markov chain in $\{0,1\}^V$ where at each time-step a randomly chosen vertex $x$ imitates the opinion of vertex $y$ with probability $P(x,y)$. The noisy voter model is a variation of the voter model in which vertices may change their opinions by the action of an external noise. The strength of this noise is measured by an extra parameter $p \in [0,1]$. The noisy voter model is a Markov chain with state space $\{0,1\}^V$, and has a unique stationary distribution $\Gamma$ when $p > 0$. In this paper, we study $\Gamma$ when the number of vertices in $V$ tends to infinity. In particular we analyse the random variable $S = \sum_{x \in V}\pi(x)\xi(x)$, where $\pi$ is the stationary distribution of the transition matrix $P$, and $\xi \in \{0,1\}$ is sampled from $\Gamma$. Allowing $P$ and $p$ to be functions of the size $|V|$, we show that, under appropriate conditions, a normalised version of $S$ converges to a Gaussian random variable. We provide further analysis of the noisy voter model on a variety of graphs including the complete graph, cycle, torus and hypercube.


title: Learning Spatial-Temporal Graphs for Active Speaker Detection

abstract: We address the problem of active speaker detection through a new framework, called SPELL, that learns long-range multimodal graphs to encode the inter-modal relationship between audio and visual data. We cast active speaker detection as a node classification task that is aware of longer-term dependencies. We first construct a graph from a video so that each node corresponds to one person. Nodes representing the same identity share edges between them within a defined temporal window. Nodes within the same video frame are also connected to encode inter-person interactions. Through extensive experiments on the Ava-ActiveSpeaker dataset, we demonstrate that learning graph-based representation, owing to its explicit spatial and temporal structure, significantly improves the overall performance. SPELL outperforms several relevant baselines and performs at par with state of the art models while requiring an order of magnitude lower computation cost.


title: On Stretching, Bending, Shearing and Twisting of Actin Filaments I: Variational Models

abstract: Mechanochemical simulations of actomyosin networks are traditionally based on one-dimensional models of actin filaments having zero width. Here, and in the follow up paper, approaches are presented for more efficient modelling which incorporates stretching, bending, shearing and twisting of actin filaments. Our modelling of a semi-flexible filament with a small but finite width is based on the Cosserat theory of elastic rods, which allows for six degrees of freedom at every point on the filament's backbone. In the variational models presented in this paper, a small and discrete set of parameters is used to describe a smooth filament shape having all degrees of freedom allowed in the Cosserat theory. Two main approaches are introduced: one where polynomial spline functions describe the filament's configuration, and one in which geodesic curves in the space of the configurational degrees of freedom are used. We find that in the latter representation the strain energy function can be calculated without resorting to a small-angle expansion, so it can describe arbitrarily large filament deformations without systematic error. These approaches are validated by a dynamical model of a Cosserat filament, which can be further extended by using multi-resolution methods to allow more detailed monomer-based resolution in certain parts of the actin filament, as introduced in the follow up paper. The presented framework is illustrated by showing how torsional compliance in a finite-width filament can induce broken chiral symmetry in the structure of a cross-linked bundle.


title: Small elementary components of Hilbert schemes of points

abstract: We answer an open problem posed by Iarrobino in the '80s: is there an elementary component of the Hilbert scheme of points $\textrm{Hilb}^d(\mathbb{A}^n)$ with dimension less than $(n-1)(d-1)$? We construct an infinite class of such components in $\textrm{Hilb}^d(\mathbb{A}^4)$. Our techniques also allow us to construct an explicit example of a local Artinian ring with trivial negative tangents, vanishing nonnegative obstruction space, and socle-dimension $2$.


title: Temperature induced Neutral to Ionic phase Transition of the charge transfer crystal Tetrathiafulvalene-Fluoranil

abstract: The Temperature Induced Neutral to Ionic phase Transition (TI-NIT) is a rare phenomenon occurring in mixed stack charge transfer (CT) crystals made up of alternating $\pi$-electron Donor (D) and Acceptor (A) molecules. We were able to grow crystals of Tetrathiafulvalene-Fluoranil (TTF-FA), and to show that it undergoes TI-NIT like the prototype CT crystal TTF-Chloranil. We characterized both room and low T phases through IR and Raman spectroscopy and XRD, demonstrating that while TTF-FA is quasi-neutral at room T, its ionicity jumps from 0.15 to 0.7 at low T, therefore crossing the Neutral-Ionic borderline. The transition, occuring around 150K, is first order, with large thermal hysteresis and accompanied by crystal cracking. In the high T phase D and A molecules lie on inversion center, i.e. the stacks are regular, whereas the low T phase is characterized by the loss of the inversion symmetry along the stack as the stacks are strongly dimerized and by the doubling of the unit cell.


title: Lifshitz black holes in four-dimensional Critical Gravity

abstract: In this work, we study the existence of asymptotically Lifshitz black holes in Critical Gravity in four dimensions with a negative cosmological constant under two scenarios: First, including dilatonic fields as the matter source, where we find an asymptotically Lifshitz solution for a fixed value of the dynamical exponent $z=4$. As a second case, we also added a non-minimally coupled scalar field $\Phi$ with a potential given by a mass term and a quartic term. Using this approach, we found a solution for $z$ defined in the interval $(1,4)$, recovering the Schwarzchild-Anti-de Sitter case with planar base manifold in the isotropic limit. Moreover, when we analyzed the limiting case $z=4$, we found that there exists an additional solution that can be interpreted as a stealth configuration in which the stealth field is overflying the $z=4$ solution without the non-minimally coupled field $\Phi$. Finally, we studied the non-trivial thermodynamics of these new anisotropic solutions and found that they all satisfy the First Law of Thermodynamics as well as the Smarr relation. We were also able to determine that the non-stealth configuration is thermodynamically preferred in this case.


title: Safe Reinforcement Learning for Grid Voltage Control

abstract: Under voltage load shedding has been considered as a standard approach to recover the voltage stability of the electric power grid under emergency conditions, yet this scheme usually trips a massive amount of load inefficiently. Reinforcement learning (RL) has been adopted as a promising approach to circumvent the issues; however, RL approach usually cannot guarantee the safety of the systems under control. In this paper, we discuss a couple of novel safe RL approaches, namely constrained optimization approach and Barrier function-based approach, that can safely recover voltage under emergency events. This method is general and can be applied to other safety-critical control problems. Numerical simulations on the 39-bus IEEE benchmark are performed to demonstrate the effectiveness of the proposed safe RL emergency control.


title: Anomalies of fermionic CFTs via cobordism and bootstrap

abstract: We study constraints on the space of $d=2$ fermionic CFTs as a function of non-perturbative anomalies exhibited under a fermionic discrete symmetry group $G^f$, focusing our attention also on cases where $G^f$ is non-abelian or presents a non-trivial twist of the $\mathbb{Z}^f_2$ subgroup. For the cases we selected, among our results we find that modular bootstrap consistency bounds predict the presence of relevant/marginal operators only for some groups and anomalies. From this point of view, the appearance in the analysis of several kinks around irrelevant operators with $\Delta>2$ means that for fermionic systems with increasingly larger symmetry groups modular bootstrap is able to give less constraining bounds than its bosonic counterpart. Within our analysis we show how the anomaly constraints on fermionic CFTs can be effectively recovered from the structure of the abelian subgroups of $G^f$. Finally, we extend the previous surgery description of bordism invariants that describe $3d$ abelian spin-TQFTs, in order to include the case of theories with $\mathrm{Spin}\text{-}\mathbb{Z}^f_{2^{l+1}}$ structures.


title: Simple Alternatives to the Common Correlated Effects Model

abstract: We study estimation of factor models in a fixed-T panel data setting and significantly relax the common correlated effects (CCE) assumptions pioneered by Pesaran (2006) and used in dozens of papers since. In the simplest case, we model the unobserved factors as functions of the cross-sectional averages of the explanatory variables and show that this is implied by Pesaran's assumptions when the number of factors does not exceed the number of explanatory variables. Our approach allows discrete explanatory variables and flexible functional forms in the covariates. Plus, it extends to a framework that easily incorporates general functions of cross-sectional moments, in addition to heterogeneous intercepts and time trends. Our proposed estimators include Pesaran's pooled correlated common effects (CCEP) estimator as a special case. We also show that in the presence of heterogeneous slopes our estimator is consistent under assumptions much weaker than those previously used. We derive the fixed-T asymptotic normality of a general estimator and show how to adjust for estimation of the population moments in the factor loading equation.


title: The SHiP experiment at the proposed CERN SPS Beam Dump Facility

abstract: The Search for Hidden Particles (SHiP) Collaboration has proposed a general-purpose experimental facility operating in beam-dump mode at the CERN SPS accelerator to search for light, feebly interacting particles. The SHiP experiment incorporates two complementary detectors. The upstream detector is designed for recoil signatures of light dark matter (LDM) scattering and for neutrino physics, in particular with tau neutrinos. It consists of a spectrometer magnet housing a layered detector system with high-density LDM/neutrino target plates, emulsion-film technology and electronic high-precision tracking. The downstream detector system aims at measuring visible decays of feebly interacting particles to both fully reconstructed final states and to partially reconstructed final states with neutrinos, in a nearly background-free environment. The detector consists of a 50\m long decay volume under vacuum followed by a spectrometer and particle identification system with a rectangular acceptance of 5\,m in width and 10\,m in height. Using the high-intensity beam of 400\gev protons, the experiment aims at profiting from the $4\times 10^{19}$ protons per year that are currently unexploited at the SPS, over a period of 5--10 years. This allows probing dark photons, dark scalars and pseudo-scalars, and heavy neutral leptons with GeV-scale masses at sensitivities that largely exceed those of existing and projected experiments. The sensitivity to light dark matter reaches well below the dark matter relic density limits in the range from a few \mevcc up to 100\,MeV-scale masses, and it will be possible to study tau neutrino interactions with unprecedented statistics. This paper describes the SHiP experiment baseline setup and the detector systems, together with performance results from prototypes in test beams, as it was prepared for the 2020 Update of the European Strategy for Particle Physics.


title: ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction

abstract: Neural information retrieval (IR) has greatly advanced search and other knowledge-intensive language tasks. While many neural IR methods encode queries and documents into single-vector representations, late interaction models produce multi-vector representations at the granularity of each token and decompose relevance modeling into scalable token-level computations. This decomposition has been shown to make late interaction more effective, but it inflates the space footprint of these models by an order of magnitude. In this work, we introduce ColBERTv2, a retriever that couples an aggressive residual compression mechanism with a denoised supervision strategy to simultaneously improve the quality and space footprint of late interaction. We evaluate ColBERTv2 across a wide range of benchmarks, establishing state-of-the-art quality within and outside the training domain while reducing the space footprint of late interaction models by 6--10$\times$.


title: obscura: A modular C++ tool and library for the direct detection of (sub-GeV) dark matter via nuclear and electron recoils

abstract: For the interpretation of past and future direct searches for dark matter (DM) particles, it is important to be able to provide accurate predictions for event rates and spectra under a variety of possible and viable assumptions in a computationally efficient way. While there exists a few tools to compute DM induced nuclear recoil spectra, 'obscura' is not limited to nuclear targets. Instead its main focus lies on sub-GeV DM searches probing electron recoils which typically requires methods from atomic and condensed matter physics. In the context of sub-GeV DM searches, new ideas such as target materials or detection techniques are being proposed regularly, and the theoretical modelling of these are getting improved continuously. At the same time, currently running experiments continue to publish their results and analyses, setting increasingly strict bounds on the DM parameter space. In such a dynamic field, 'obscura' can be an invaluable tool due to its high level of adaptability and facilitate and accelerate the development of new, reliable research software for the preparation of a DM discovery in the hopefully near future.


title: Stochastic Quantization of General Relativity \`a la Ricci-Flow

abstract: We follow a new pathway to the definition of the Stochastic Quantization (SQ), first proposed by Parisi and Wu, of the action functional yielding the Einstein equations. Hinging on the functional similarities between the Ricci-Flow equation and the SQ Langevin equations proposed by Rumpf, we push forward a novel approach with multiplicative noise and a stochastic time that converges to the proper time of a space-like foliation in the equilibrium limit. Furthermore, we express the starting system of equations using the Arnowitt-Deser-Misner (ADM) variables and their conjugated Hamiltonian momenta. Such a choice is instrumental in understanding the newly derived equations in terms of the breakdown of the diffeomorphism invariance of the classical theory, which instead will hold on average at the steady state. We comment on the physical interpretation of the Ricci flow equations, and argue how they can naturally provide, in a geometrical way, the renormalization group equation for gravity theories. In the general setting, the equation associated to the shift vector yields the Navier-Stokes equation with a stochastic source. Moreover, we show that the fluctuations of the metric tensor components around the equilibrium configurations, far away from the horizon of a Schwarzschild black hole, are forced by the Ricci flow to follow the Kardar-Parisi-Zhang equation, whose probabilistic distribution can yield an intermittent statistics. We finally comment on the possible applications of this novel scenario to the cosmological constant, arguing that the Ricci flow may provide a solution to the Hubble tension, as a macroscopic effect of scale dependence of the quantum fluctuations of the metric tensor.


title: Impact of bound states on non-thermal dark matter production

abstract: We explore the impact of non-perturbative effects, namely Sommerfeld enhancement and bound state formation, on the cosmological production of non-thermal dark matter. For this purpose, we focus on a class of simplified models with t-channel mediators. These naturally combine the requirements for large corrections in the early Universe, i.e. beyond the Standard Model states with long range interactions, with a sizable new physics production cross section at the LHC. We find that the dark matter yield of the superWIMP mechanism is suppressed considerably due to the non-perturbative effects under consideration. This leads to a significant shift in the cosmologically preferred parameter space of non-thermal dark matter in these models. We also revisit the implications of LHC bounds on long-lived particles associated with non-thermal dark matter and find that testing this scenario at the LHC is a bigger challenge than previously anticipated.


title: Testing f(R) gravity models with quasar X-ray and UV fluxes

abstract: Recently, Active Galactic Nuclei (AGNs) have been proposed as standardizable candles, thanks to an observed non-linear relation between their X-ray and optical-ultraviolet (UV) luminosities, which provides an independent measurement of their distances. In this paper, we use these observables for the first time to estimate the parameters of f(R) gravity models (specifically the Hu-Sawicki and the exponential models) together with the cosmological parameters. The importance of this type of modified gravity theories lies in the fact that they can explain the late time accelerated expansion of the universe without the inclusion of a dark energy component. We have also included other observable data to the analyses such as estimates of the Hubble parameter H(z) from Cosmic Chronometers, the Pantheon Type Ia supernovae compilation, and Baryon Acoustic Oscillations measurements. Our results show that the allowed space parameter is restricted when both AGN and BAO data are added to CC and SnIa data, being the BAO data set the most restrictive one. We can also conclude that even though our results are consistent with the ones from the LCDM model, small deviations from General Relativity, than can be successfully described by the f(R) models studied in this paper, are also allowed by the considered data sets.


title: Back action evading electro-optical transducer

abstract: Electro-optical transducers are utilized for upconvertion of radio frequency (RF) signals to the optical frequency domain to study the RF signals with optical tools. The transducers frequently impact on the RF system and introduce additional noise, including optical shot noise as well as quantum back action noise, limiting the measurement accuracy. In this paper we theoretically study a technique based on a high efficiency electro-optical phase modulation effect that allows back action evading detection of an RF field quadrature. The main idea of proposed method is independent homodyne detection of two (Stokes and anti-Stokes) optical modes. It allows subsequent postprocessing of the detected signals, which, in turn, results in a broadband back action evading measurement leading to the high sensitivity evaluation of the RF signals.


title: Improvement of the NOvA Near Detector Event Reconstruction and Primary Vertexing through the Application of Machine Learning Methods

abstract: The purpose of this work is to examine the application of a deep learning model in event reconstruction of neutrino interactions. The challenges faced in event reconstruction include the placement of an accurate primary neutrino interaction vertex which is used to support the particle track and prong algorithms. The result of accurate primary vertex ensures all particles involved in a neutrino interaction are included. We propose a regression-based Convolutional Neural Network (CNN) method to predict the primary vertex of a particle interaction. We show that with raw two-dimensional pixel map views as input, the regression-based CNN can predict the primary vertex in all three coordinates. This work is applied as part of the NOvA (NuMI Off-axis $\nu_e$ Appearance) near detector reconstruction efforts. The primary vertex predicted by the regression-based CNN model shows promising results for future applications. This deep learning method can be extended to secondary vertexing through a Kernel Density Estimate algorithm discussed in this work.


title: Mass distributions for the Kepler problem

abstract: The regularities in the structure of the planetary system, expressed by the Titius-Bode law, can be accounted also by using a more general formula, derived not by fit but from a logarithmic integrality constraint on the angular momentum (areolar velocity). This work presents the elementary adiabatic invariant used in constraint, the new formula, and applications to the orbit spacing, numbering and mass distributions for planets and the Jupiter satellites.


title: Analysis of an adaptive lead weighted ResNet for multiclass classification of 12-lead ECGs

abstract: Background: Twelve lead ECGs are a core diagnostic tool for cardiovascular diseases. Here, we describe and analyse an ensemble deep neural network architecture to classify 24 cardiac abnormalities from 12-lead ECGs. Method: We proposed a squeeze and excite ResNet to automatically learn deep features from 12-lead ECGs, in order to identify 24 cardiac conditions. The deep features were augmented with age and gender features in the final fully connected layers. Output thresholds for each class were set using a constrained grid search. To determine why the model made incorrect predictions, two expert clinicians independently interpreted a random set of 100 misclassified ECGs concerning Left Axis Deviation. Results: Using the bespoke weighted accuracy metric, we achieved a 5-fold cross validation score of 0.684, and sensitivity and specificity of 0.758 and 0.969, respectively. We scored 0.520 on the full test data, and ranked 2nd out of 41 in the official challenge rankings. On a random set of misclassified ECGs, agreement between two clinicians and training labels was poor (clinician 1: kappa = -0.057, clinician 2: kappa = -0.159). In contrast, agreement between the clinicians was very high (kappa = 0.92). Discussion: The proposed prediction model performed well on the validation and hidden test data in comparison to models trained on the same data. We also discovered considerable inconsistency in training labels, which is likely to hinder development of more accurate models.


title: Role of gravitational decoupling on isotropization and complexity of self-gravitating system under complete geometric deformation approach

abstract: In the present paper, we discuss the role of gravitational decoupling to isotropize the anisotropic solution of Einstein's field equations in the context of the complete geometric deformation (CGD) approach and its influence on the complexity factor introduced by L. Herrera (Phys. Rev. D 97, 044010 (2018)) in the static self-gravitating system. Moreover, we also proposed a simple and effective technique to generate new solutions for self-gravitating objects via CGD approach by using two systems with the same complexity factor and vanishing complexity factor proposed by Casadio et al. Eur. Phys. J. C 79, 826 (2019). The effect of decoupling constant and the compactness on the complexity factor have been also analyzed for the obtained solutions.


title: Near-optimal covariant quantum error-correcting codes from random unitaries with symmetries

abstract: Quantum error correction and symmetries play central roles in quantum information science and physics. It is known that quantum error-correcting codes that obey (are covariant with respect to) continuous symmetries in a certain sense cannot correct erasure errors perfectly (a well-known result in this regard being the Eastin-Knill theorem in the context of fault-tolerant quantum computing), in contrast to the case without symmetry constraints. Furthermore, several quantitative fundamental limits on the accuracy of such covariant codes for approximate quantum error correction are known. Here, we consider the quantum error correction capability of uniformly random covariant codes. In particular, we analytically study the most essential cases of $U(1)$ and $SU(d)$ symmetries, and show that for both symmetry groups the error of the covariant codes generated by Haar-random symmetric unitaries, i.e., unitaries that commute with the group actions, typically scale as $O(n^{-1})$ in terms of both the average- and worst-case purified distances against erasure noise, saturating the fundamental limits to leading order. We note that the results hold for symmetric variants of unitary 2-designs, and comment on the convergence problem of symmetric random circuits. Our results not only indicate (potentially efficient) randomized constructions of optimal $U(1)$- and $SU(d)$-covariant codes, but also reveal fundamental properties of random symmetric unitaries, which yield important solvable models of complex quantum systems (including black holes and many-body spin systems) that have attracted great recent interest in quantum gravity and condensed matter physics. We expect our construction and analysis to find broad relevance in both physics and quantum computing.

categories: quant-ph cond-mat.stat-mech hep-th math-ph math.MP


title: Bound-state effects on dark matter coannihilation: Pushing the boundaries of conversion-driven freeze-out

abstract: Bound-state formation can have a large impact on the dynamics of dark matter freeze-out in the early Universe, in particular for colored coannihilators. We present a general formalism to include an arbitrary number of excited bound states in terms of an effective annihilation cross section, taking bound-state formation, decay and transitions into account, and derive analytic approximations in the limiting cases of no or efficient transitions. Furthermore, we provide explicit expressions for radiative bound-state formation rates for states with arbitrary principal and angular quantum numbers $n,\ell$ for a mediator in the fundamental representation of $SU(3)_c$, as well as electromagnetic transition rates among them in the Coulomb approximation. We then assess the impact of bound states within a model with Majorana dark matter and a colored scalar $t$-channel mediator. We consider the regime of coannihilation as well as conversion-driven freeze-out (or coscattering), where the relic abundance is set by the freeze-out of conversion processes. We find that the region in parameter space where the latter occurs is considerably enhanced into the multi-TeV regime. For conversion-driven freeze-out, dark matter is very weakly coupled, evading direct and indirect detection constraints but leading to prominent signatures of long-lived particles that provide great prospects to be probed by dedicated searches at the upcoming LHC runs.


title: $B\to P,V$ form factors with the $B$-meson light-cone sum rules

abstract: In this review, we discuss the calculation of the $B\to P,V$ form factors within the framework of the light-cone sum rules with the light-cone distribution amplitudes of the $B$ meson. A detailed introduction to the definition, scale evolution, and phenomenological models of the $B$-meson distribution amplitudes is presented. We show two equivalent approaches of calculating the next-to-leading order QCD corrections to the sum rules for the form factors, i.e., the method of regions and the step-by-step matching in the soft-collinear effective theory. The power suppressed corrections to the $B\to P,V$ form factors especially the contributions from the higher-twist $B$-meson distribution amplitudes are displayed. We also present numerical results of the form factors including both the QCD and the power corrections, and phenomenological applications of the predicted form factors such as the determination of the CKM matrix element $|V_{ub}|$.


title: Measuring the Polarization Reconstruction Resolution of the ARIANNA Neutrino Detector with Cosmic Rays

abstract: The ARIANNA detector is designed to detect neutrinos with energies above $10^{17}$eV. Due to the similarities in generated radio signals, cosmic rays are often used as test beams for neutrino detectors. Some ARIANNA detector stations are equipped with antennas capable of detecting air showers. Since the radio emission properties of air showers are well understood, and the polarization of the radio signal can be predicted from the arrival direction, cosmic rays can be used as a proxy to assess the reconstruction capabilities of the ARIANNA neutrino detector. We report on dedicated efforts of reconstructing the polarization of cosmic-ray radio pulses. After correcting for difference in hardware, the two stations used in this study showed similar performance in terms of event rate and agreed with simulation. Subselecting high quality cosmic rays, the polarizations of these cosmic rays were reconstructed with a resolution of $2.5^{\circ}$ (68% containment), which agrees with the expected value obtained from simulation. A large fraction of this resolution originates from uncertainties in the predicted polarization because of the contribution of the subdominant Askaryan effect in addition to the dominant geomagnetic emission. Subselecting events with a zenith angle greater than $70^{\circ}$ removes most influence of the Askaryan emission, and, with limited statistics, we found the polarization uncertainty is reduced to $1.3^{\circ}$ (68% containment).


title: Dimensions of Motion: Monocular Prediction through Flow Subspaces

abstract: We introduce a way to learn to estimate a scene representation from a single image by predicting a low-dimensional subspace of optical flow for each training example, which encompasses the variety of possible camera and object movement. Supervision is provided by a novel loss which measures the distance between this predicted flow subspace and an observed optical flow. This provides a new approach to learning scene representation tasks, such as monocular depth prediction or instance segmentation, in an unsupervised fashion using in-the-wild input videos without requiring camera poses, intrinsics, or an explicit multi-view stereo step. We evaluate our method in multiple settings, including an indoor depth prediction task where it achieves comparable performance to recent methods trained with more supervision.


title: Machine Learning-Based Classification Algorithms for the Prediction of Coronary Heart Diseases

abstract: Coronary heart disease, which is a form of cardiovascular disease (CVD), is the leading cause of death worldwide. The odds of survival are good if it is found or diagnosed early. The current report discusses a comparative approach to the classification of coronary heart disease datasets using machine learning (ML) algorithms. The current study created and tested several machine-learning-based classification models. The dataset was subjected to Smote to handle unbalanced classes and feature selection technique in order to assess the impact on two distinct performance metrics. The results show that logistic regression produced the highest performance score on the original dataset compared to the other algorithms employed. In conclusion, this study suggests that LR on a well-processed and standardized dataset can predict coronary heart disease with greater accuracy than the other algorithms.


title: Neural Weight Step Video Compression

abstract: A variety of compression methods based on encoding images as weights of a neural network have been recently proposed. Yet, the potential of similar approaches for video compression remains unexplored. In this work, we suggest a set of experiments for testing the feasibility of compressing video using two architectural paradigms, coordinate-based MLP (CbMLP) and convolutional network. Furthermore, we propose a novel technique of neural weight stepping, where subsequent frames of a video are encoded as low-entropy parameter updates. To assess the feasibility of the considered approaches, we will test the video compression performance on several high-resolution video datasets and compare against existing conventional and neural compression techniques.


title: Primordial black holes from spectator field bubbles

abstract: We study the evolution of light spectator fields in an asymmetric polynomial potential. During inflation, stochastic fluctuations displace the spectator field from the global minimum of its potential, populating the false vacuum state and thereby allowing for the formation of false vacuum bubbles. By using a lattice simulation, we show that these bubbles begin to contract once they re-enter the horizon and, if sufficiently large, collapse into black holes. This process generally results in the formation of primordial black holes, which, due to the specific shape of their mass function, are constrained to yield at most 1% of the total dark matter abundance. However, the resulting population can source gravitational wave signals observable at the LIGO-Virgo experiments, provide seeds for supermassive black holes or cause a transient matter-dominated phase in the early Universe.


title: Sample Complexity of Robust Reinforcement Learning with a Generative Model

abstract: The Robust Markov Decision Process (RMDP) framework focuses on designing control policies that are robust against the parameter uncertainties due to the mismatches between the simulator model and real-world settings. An RMDP problem is typically formulated as a max-min problem, where the objective is to find the policy that maximizes the value function for the worst possible model that lies in an uncertainty set around a nominal model. The standard robust dynamic programming approach requires the knowledge of the nominal model for computing the optimal robust policy. In this work, we propose a model-based reinforcement learning (RL) algorithm for learning an $\epsilon$-optimal robust policy when the nominal model is unknown. We consider three different forms of uncertainty sets, characterized by the total variation distance, chi-square divergence, and KL divergence. For each of these uncertainty sets, we give a precise characterization of the sample complexity of our proposed algorithm. In addition to the sample complexity results, we also present a formal analytical argument on the benefit of using robust policies. Finally, we demonstrate the performance of our algorithm on two benchmark problems.


title: Simulating thermal density operators with cluster expansions and tensor networks

abstract: We provide an efficient approximation for the exponential of a local operator in quantum spin systems using tensor-network representations of a cluster expansion. We benchmark this cluster tensor network operator (cluster TNO) for one-dimensional systems, and show that the approximation works well for large real- or imaginary-time steps. We use this formalism for representing the thermal density operator of a two-dimensional quantum spin system at a certain temperature as a single cluster TNO, which we can then contract by standard contraction methods for two-dimensional tensor networks. We apply this approach to the thermal phase transition of the transverse-field Ising model on the square lattice, and we find through a scaling analysis that the cluster-TNO approximation gives rise to a continuous phase transition in the correct universality class; by increasing the order of the cluster expansion we find good values of the critical point up to surprisingly low temperatures.


title: The cosmological simulation code $\scriptstyle{\rm CO}N{\rm CEPT}\, 1.0$

abstract: We present version 1.0 of the cosmological simulation code $\scriptstyle{\rm CO}N{\rm CEPT}$, designed for simulations of large-scale structure formation. $\scriptstyle{\rm CO}N{\rm CEPT}\, 1.0$ contains a P$^3$M gravity solver, with the short-range part implemented using a novel (sub)tiling strategy, coupled with individual and adaptive particle time-stepping. A primary objective of $\scriptstyle{\rm CO}N{\rm CEPT}$ is ease of use. To this end, it has built-in initial condition generation and can produce output in the form of snapshots, power spectra and direct visualisations. $\scriptstyle{\rm CO}N{\rm CEPT}$ is the first massively parallel cosmological simulation code written in Python. Despite of this, excellent performance is obtained, even comparing favourably to other codes such as $\scriptstyle{\rm GADGET}$ at similar precision, in the case of low to moderate clustering. By means of power spectrum comparisons we find extraordinary good agreement between $\scriptstyle{\rm CO}N{\rm CEPT}\, 1.0$ and $\scriptstyle{\rm GADGET}$. At large and intermediate scales the codes agree to well below the per mille level, while the agreement at the smallest scales probed ($k \sim 13\, h/{\rm Mpc}$) is of the order of $1\, \%$. The $\scriptstyle{\rm CO}N{\rm CEPT}$ code is openly released and comes with a robust installation script as well as thorough documentation.


title: Quadratic-in-spin interactions at fifth post-Newtonian order probe new physics

abstract: We obtain for the first time all quadratic-in-spin interactions in spinning binaries at the third subleading order in post-Newtonian (PN) gravity, and provide their observable binding energies and their gauge-invariant relations to the angular momentum. Our results are valid for generic compact objects, orbits, and spin orientations, and enter at the fifth PN order for maximally-rotating objects, thus pushing the state of the art. This is accomplished through an extension of the effective field theory of spinning gravitating objects, and of its computational application. We also discover a new finite-size effect which is unique to spinning objects, with a new ``Spin Love number'' as its characteristic coefficient, that is a new probe for gravity and QCD.


title: On Gromov's dihedral extremality and rigidity conjectures

abstract: In this paper, we develop a new index theory for manifolds with polyhedral boundary. As an application, we prove Gromov's dihedral extremality conjecture regarding comparisons of scalar curvatures, mean curvatures and dihedral angles between two compact manifolds with polyhedral boundary in all dimensions. We also prove Gromov's dihedral rigidity conjecture for a class of positively curved manifolds with polyhedral boundary in all dimensions.


title: The Surprising Effectiveness of Representation Learning for Visual Imitation

abstract: While visual imitation learning offers one of the most effective ways of learning from visual demonstrations, generalizing from them requires either hundreds of diverse demonstrations, task specific priors, or large, hard-to-train parametric models. One reason such complexities arise is because standard visual imitation frameworks try to solve two coupled problems at once: learning a succinct but good representation from the diverse visual data, while simultaneously learning to associate the demonstrated actions with such representations. Such joint learning causes an interdependence between these two problems, which often results in needing large amounts of demonstrations for learning. To address this challenge, we instead propose to decouple representation learning from behavior learning for visual imitation. First, we learn a visual representation encoder from offline data using standard supervised and self-supervised learning methods. Once the representations are trained, we use non-parametric Locally Weighted Regression to predict the actions. We experimentally show that this simple decoupling improves the performance of visual imitation models on both offline demonstration datasets and real-robot door opening compared to prior work in visual imitation. All of our generated data, code, and robot videos are publicly available at https://jyopari.github.io/VINN/.


title: Rotating and vibrating symmetric top molecule RaOCH$_3$ in the fundamental $\mathcal{P}$, $\mathcal{T}$-violation searches

abstract: We study the influence of the rotations and vibrations of the symmetric top RaOCH$_3$ molecule on its effectiveness as a probe for the $\mathcal{P}$ and $\mathcal{T}$-violating effects, such as the electron electric dipole moment (eEDM) and the scalar-pseudoscalar electron-nucleon interaction (Ne-SPS). The corresponding enhancement parameters $E_{\rm eff}$ and $E_{\rm s}$ are computed for the ground and first excited rovibrational states with different values of the angular momentum component $K$. For the lowest $K$-doublet with $v_\perp=0$ and $K=1$ the values are $E_{\rm eff}=47.647\,\mathrm{GV/cm}$ and $E_{\rm s}=62.109\,\mathrm{kHz}$. The results show larger deviation from the equilibrium values than in triatomic molecules.

categories: physics.atom-ph hep-ph physics.chem-ph quant-ph


title: OW-DETR: Open-world Detection Transformer

abstract: Open-world object detection (OWOD) is a challenging computer vision problem, where the task is to detect a known set of object categories while simultaneously identifying unknown objects. Additionally, the model must incrementally learn new classes that become known in the next training episodes. Distinct from standard object detection, the OWOD setting poses significant challenges for generating quality candidate proposals on potentially unknown objects, separating the unknown objects from the background and detecting diverse unknown objects. Here, we introduce a novel end-to-end transformer-based framework, OW-DETR, for open-world object detection. The proposed OW-DETR comprises three dedicated components namely, attention-driven pseudo-labeling, novelty classification and objectness scoring to explicitly address the aforementioned OWOD challenges. Our OW-DETR explicitly encodes multi-scale contextual information, possesses less inductive bias, enables knowledge transfer from known classes to the unknown class and can better discriminate between unknown objects and background. Comprehensive experiments are performed on two benchmarks: MS-COCO and PASCAL VOC. The extensive ablations reveal the merits of our proposed contributions. Further, our model outperforms the recently introduced OWOD approach, ORE, with absolute gains ranging from 1.8% to 3.3% in terms of unknown recall on MS-COCO. In the case of incremental object detection, OW-DETR outperforms the state-of-the-art for all settings on PASCAL VOC. Our code is available at https://github.com/akshitac8/OW-DETR.


title: Self-supervised Video Transformer

abstract: In this paper, we propose self-supervised training for video transformers using unlabeled video data. From a given video, we create local and global spatiotemporal views with varying spatial sizes and frame rates. Our self-supervised objective seeks to match the features of these different views representing the same video, to be invariant to spatiotemporal variations in actions. To the best of our knowledge, the proposed approach is the first to alleviate the dependency on negative samples or dedicated memory banks in Self-supervised Video Transformer (SVT). Further, owing to the flexibility of Transformer models, SVT supports slow-fast video processing within a single architecture using dynamically adjusted positional encoding and supports long-term relationship modeling along spatiotemporal dimensions. Our approach performs well on four action recognition benchmarks (Kinetics-400, UCF-101, HMDB-51, and SSv2) and converges faster with small batch sizes. Code: https://git.io/J1juJ


title: TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentation

abstract: Unsupervised semantic segmentation aims to obtain high-level semantic representation on low-level visual features without manual annotations. Most existing methods are bottom-up approaches that try to group pixels into regions based on their visual cues or certain predefined rules. As a result, it is difficult for these bottom-up approaches to generate fine-grained semantic segmentation when coming to complicated scenes with multiple objects and some objects sharing similar visual appearance. In contrast, we propose the first top-down unsupervised semantic segmentation framework for fine-grained segmentation in extremely complicated scenarios. Specifically, we first obtain rich high-level structured semantic concept information from large-scale vision data in a self-supervised learning manner, and use such information as a prior to discover potential semantic categories presented in target datasets. Secondly, the discovered high-level semantic categories are mapped to low-level pixel features by calculating the class activate map (CAM) with respect to certain discovered semantic representation. Lastly, the obtained CAMs serve as pseudo labels to train the segmentation module and produce the final semantic segmentation. Experimental results on multiple semantic segmentation benchmarks show that our top-down unsupervised segmentation is robust to both object-centric and scene-centric datasets under different semantic granularity levels, and outperforms all the current state-of-the-art bottom-up methods. Our code is available at \url{https://github.com/damo-cv/TransFGU}.


title: Ownership and Creativity in Generative Models

abstract: Machine learning generated content such as image artworks, textual poems and music become prominent in recent years. These tools attract much attention from the media, artists, researchers, and investors. Because these tools are data-driven, they are inherently different than the traditional creative tools which arises the question - who may own the content that is generated by these tools? In this paper we aim to address this question, we start by providing a background to this problem, raising several candidates that may own the content and arguments for each one of them. Then we propose a possible algorithmic solution in the vision-based model's regime. Finally, we discuss the broader implications of this problem.


title: Efficient Neural Radiance Fields for Interactive Free-viewpoint Video

abstract: This paper aims to tackle the challenge of efficiently producing interactive free-viewpoint videos. Some recent works equip neural radiance fields with image encoders, enabling them to generalize across scenes. When processing dynamic scenes, they can simply treat each video frame as an individual scene and perform novel view synthesis to generate free-viewpoint videos. However, their rendering process is slow and cannot support interactive applications. A major factor is that they sample lots of points in empty space when inferring radiance fields. We propose a novel scene representation, called ENeRF, for the fast creation of interactive free-viewpoint videos. Specifically, given multi-view images at one frame, we first build the cascade cost volume to predict the coarse geometry of the scene. The coarse geometry allows us to sample few points near the scene surface, thereby significantly improving the rendering speed. This process is fully differentiable, enabling us to jointly learn the depth prediction and radiance field networks from RGB images. Experiments on multiple benchmarks show that our approach exhibits competitive performance while being at least 60 times faster than previous generalizable radiance field methods.


title: DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting

abstract: Recent progress has shown that large-scale pre-training using contrastive image-text pairs can be a promising alternative for high-quality visual representation learning from natural language supervision. Benefiting from a broader source of supervision, this new paradigm exhibits impressive transferability to downstream classification tasks and datasets. However, the problem of transferring the knowledge learned from image-text pairs to more complex dense prediction tasks has barely been visited. In this work, we present a new framework for dense prediction by implicitly and explicitly leveraging the pre-trained knowledge from CLIP. Specifically, we convert the original image-text matching problem in CLIP to a pixel-text matching problem and use the pixel-text score maps to guide the learning of dense prediction models. By further using the contextual information from the image to prompt the language model, we are able to facilitate our model to better exploit the pre-trained knowledge. Our method is model-agnostic, which can be applied to arbitrary dense prediction systems and various pre-trained visual backbones including both CLIP models and ImageNet pre-trained models. Extensive experiments demonstrate the superior performance of our methods on semantic segmentation, object detection, and instance segmentation tasks. Code is available at https://github.com/raoyongming/DenseCLIP


title: Long-range entanglement from measuring symmetry-protected topological phases

abstract: A fundamental distinction between many-body quantum states are those with short- and long-range entanglement (SRE and LRE). The latter cannot be created by finite-depth circuits, underscoring the nonlocal nature of Schr\"odinger cat states, topological order, and quantum criticality. Remarkably, examples are known where LRE is obtained by performing single-site measurements on SRE, such as the toric code from measuring a sublattice of a 2D cluster state. However, a systematic understanding of when and how measurements of SRE give rise to LRE is still lacking. Here, we establish that LRE appears upon performing measurements on symmetry-protected topological (SPT) phases -- of which the cluster state is one example. For instance, we show how to implement the Kramers-Wannier transformation by adding a cluster SPT to an input state followed by measurement. This transformation naturally relates states with SRE and LRE. An application is the realization of double-semion order when the input state is the $\mathbb Z_2$ Levin-Gu SPT. Similarly, the addition of fermionic SPTs and measurement leads to an implementation of the Jordan-Wigner transformation of a general state. More generally, we argue that a large class of SPT phases protected by $G \times H$ symmetry gives rise to anomalous LRE upon measuring $G$-charges, and we prove that this persists for generic points in the SPT phase under certain conditions. Our work introduces a new practical tool for using SPT phases as resources for creating LRE, and uncovers the classification result that all states related by sequentially gauging Abelian groups or by Jordan-Wigner transformation are in the same equivalence class, once we augment finite-depth circuits with single-site measurements. In particular, any topological or fracton order with a solvable finite gauge group can be obtained from a product state in this way.


title: Recognizing Scenes from Novel Viewpoints

abstract: Humans can perceive scenes in 3D from a handful of 2D views. For AI agents, the ability to recognize a scene from any viewpoint given only a few images enables them to efficiently interact with the scene and its objects. In this work, we attempt to endow machines with this ability. We propose a model which takes as input a few RGB images of a new scene and recognizes the scene from novel viewpoints by segmenting it into semantic categories. All this without access to the RGB images from those views. We pair 2D scene recognition with an implicit 3D representation and learn from multi-view 2D annotations of hundreds of scenes without any 3D supervision beyond camera poses. We experiment on challenging datasets and demonstrate our model's ability to jointly capture semantics and geometry of novel scenes with diverse layouts, object types and shapes.


title: Object-aware Monocular Depth Prediction with Instance Convolutions

abstract: With the advent of deep learning, estimating depth from a single RGB image has recently received a lot of attention, being capable of empowering many different applications ranging from path planning for robotics to computational cinematography. Nevertheless, while the depth maps are in their entirety fairly reliable, the estimates around object discontinuities are still far from satisfactory. This can be contributed to the fact that the convolutional operator naturally aggregates features across object discontinuities, resulting in smooth transitions rather than clear boundaries. Therefore, in order to circumvent this issue, we propose a novel convolutional operator which is explicitly tailored to avoid feature aggregation of different object parts. In particular, our method is based on estimating per-part depth values by means of superpixels. The proposed convolutional operator, which we dub "Instance Convolution", then only considers each object part individually on the basis of the estimated superpixels. Our evaluation with respect to the NYUv2 as well as the iBims dataset clearly demonstrates the superiority of Instance Convolutions over the classical convolution at estimating depth around occlusion boundaries, while producing comparable results elsewhere. Code will be made publicly available upon acceptance.


title: Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks

abstract: Biological intelligence systems of animals perceive the world by integrating information in different modalities and processing simultaneously for various tasks. In contrast, current machine learning research follows a task-specific paradigm, leading to inefficient collaboration between tasks and high marginal costs of developing perception models for new tasks. In this paper, we present a generic perception architecture named Uni-Perceiver, which processes a variety of modalities and tasks with unified modeling and shared parameters. Specifically, Uni-Perceiver encodes different task inputs and targets from arbitrary modalities into a unified representation space with a modality-agnostic Transformer encoder and lightweight modality-specific tokenizers. Different perception tasks are modeled as the same formulation, that is, finding the maximum likelihood target for each input through the similarity of their representations. The model is pre-trained on several uni-modal and multi-modal tasks, and evaluated on a variety of downstream tasks, including novel tasks that did not appear in the pre-training stage. Results show that our pre-trained model without any tuning can achieve reasonable performance even on novel tasks. The performance can be improved to a level close to state-of-the-art methods by conducting prompt tuning on 1% of downstream task data. Full-data fine-tuning further delivers results on par with or better than state-of-the-art results. Code shall be released.


title: Learning Neural Light Fields with Ray-Space Embedding Networks

abstract: Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit data structures enables efficient rendering, but results in a large increase in memory footprint and, in many cases, a quality reduction. In this paper, we propose a novel neural light field representation that, in contrast, is compact and directly predicts integrated radiance along rays. Our method supports rendering with a single network evaluation per pixel for small baseline light field datasets and can also be applied to larger baselines with only a few evaluations per pixel. At the core of our approach is a ray-space embedding network that maps the 4D ray-space manifold into an intermediate, interpolable latent space. Our method achieves state-of-the-art quality on dense forward-facing datasets such as the Stanford Light Field dataset. In addition, for forward-facing scenes with sparser inputs we achieve results that are competitive with NeRF-based approaches in terms of quality while providing a better speed/quality/memory trade-off with far fewer network evaluations.


title: GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras

abstract: We present an approach for 3D global human mesh recovery from monocular videos recorded with dynamic cameras. Our approach is robust to severe and long-term occlusions and tracks human bodies even when they go outside the camera's field of view. To achieve this, we first propose a deep generative motion infiller, which autoregressively infills the body motions of occluded humans based on visible motions. Additionally, in contrast to prior work, our approach reconstructs human meshes in consistent global coordinates even with dynamic cameras. Since the joint reconstruction of human motions and camera poses is underconstrained, we propose a global trajectory predictor that generates global human trajectories based on local body movements. Using the predicted trajectories as anchors, we present a global optimization framework that refines the predicted trajectories and optimizes the camera poses to match the video evidence such as 2D keypoints. Experiments on challenging indoor and in-the-wild datasets with dynamic cameras demonstrate that the proposed approach outperforms prior methods significantly in terms of motion infilling and global mesh recovery.


title: Co-domain Symmetry for Complex-Valued Deep Learning

abstract: We study complex-valued scaling as a type of symmetry natural and unique to complex-valued measurements and representations. Deep Complex Networks (DCN) extends real-valued algebra to the complex domain without addressing complex-valued scaling. SurReal takes a restrictive manifold view of complex numbers, adopting a distance metric to achieve complex-scaling invariance while losing rich complex-valued information. We analyze complex-valued scaling as a co-domain transformation and design novel equivariant and invariant neural network layer functions for this special transformation. We also propose novel complex-valued representations of RGB images, where complex-valued scaling indicates hue shift or correlated changes across color channels. Benchmarked on MSTAR, CIFAR10, CIFAR100, and SVHN, our co-domain symmetric (CDS) classifiers deliver higher accuracy, better generalization, robustness to co-domain transformations, and lower model bias and variance than DCN and SurReal with far fewer parameters.


title: MViTv2: Improved Multiscale Vision Transformers for Classification and Detection

abstract: In this paper, we study Multiscale Vision Transformers (MViTv2) as a unified architecture for image and video classification, as well as object detection. We present an improved version of MViT that incorporates decomposed relative positional embeddings and residual pooling connections. We instantiate this architecture in five sizes and evaluate it for ImageNet classification, COCO detection and Kinetics video recognition where it outperforms prior work. We further compare MViTv2s' pooling attention to window attention mechanisms where it outperforms the latter in accuracy/compute. Without bells-and-whistles, MViTv2 has state-of-the-art performance in 3 domains: 88.8% accuracy on ImageNet classification, 58.7 boxAP on COCO object detection as well as 86.1% on Kinetics-400 video classification. Code and models are available at https://github.com/facebookresearch/mvit.


title: Masked-attention Mask Transformer for Universal Image Segmentation

abstract: Image segmentation is about grouping pixels with different semantics, e.g., category or instance membership, where each choice of semantics defines a task. While only the semantics of each task differ, current research focuses on designing specialized architectures for each task. We present Masked-attention Mask Transformer (Mask2Former), a new architecture capable of addressing any image segmentation task (panoptic, instance or semantic). Its key components include masked attention, which extracts localized features by constraining cross-attention within predicted mask regions. In addition to reducing the research effort by at least three times, it outperforms the best specialized architectures by a significant margin on four popular datasets. Most notably, Mask2Former sets a new state-of-the-art for panoptic segmentation (57.8 PQ on COCO), instance segmentation (50.1 AP on COCO) and semantic segmentation (57.7 mIoU on ADE20K).


title: A Fast Knowledge Distillation Framework for Visual Recognition

abstract: While Knowledge Distillation (KD) has been recognized as a useful tool in many visual tasks, such as supervised classification and self-supervised representation learning, the main drawback of a vanilla KD framework is its mechanism, which consumes the majority of the computational overhead on forwarding through the giant teacher networks, making the entire learning procedure inefficient and costly. ReLabel, a recently proposed solution, suggests creating a label map for the entire image. During training, it receives the cropped region-level label by RoI aligning on a pre-generated entire label map, allowing for efficient supervision generation without having to pass through the teachers many times. However, as the KD teachers are from conventional multi-crop training, there are various mismatches between the global label-map and region-level label in this technique, resulting in performance deterioration. In this study, we present a Fast Knowledge Distillation (FKD) framework that replicates the distillation training phase and generates soft labels using the multi-crop KD approach, while training faster than ReLabel since no post-processes such as RoI align and softmax operations are used. When conducting multi-crop in the same image for data loading, our FKD is even more efficient than the traditional image classification framework. On ImageNet-1K, we obtain 79.8% with ResNet-50, outperforming ReLabel by ~1.0% while being faster. On the self-supervised learning task, we also show that FKD has an efficiency advantage. Our project page: http://zhiqiangshen.com/projects/FKD/index.html, source code and models are available at: https://github.com/szq0214/FKD.


title: BEVT: BERT Pretraining of Video Transformers

abstract: This paper studies the BERT pretraining of video transformers. It is a straightforward but worth-studying extension given the recent success from BERT pretraining of image transformers. We introduce BEVT which decouples video representation learning into spatial representation learning and temporal dynamics learning. In particular, BEVT first performs masked image modeling on image data, and then conducts masked image modeling jointly with masked video modeling on video data. This design is motivated by two observations: 1) transformers learned on image datasets provide decent spatial priors that can ease the learning of video transformers, which are often times computationally-intensive if trained from scratch; 2) discriminative clues, i.e., spatial and temporal information, needed to make correct predictions vary among different videos due to large intra-class and inter-class variations. We conduct extensive experiments on three challenging video benchmarks where BEVT achieves very promising results. On Kinetics 400, for which recognition mostly relies on discriminative spatial representations, BEVT achieves comparable results to strong supervised baselines. On Something-Something-V2 and Diving 48, which contain videos relying on temporal dynamics, BEVT outperforms by clear margins all alternative baselines and achieves state-of-the-art performance with a 71.4\% and 87.2\% Top-1 accuracy respectively. Code will be made available at \url{https://github.com/xyzforever/BEVT}.


title: StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions

abstract: We apply style transfer on mesh reconstructions of indoor scenes. This enables VR applications like experiencing 3D environments painted in the style of a favorite artist. Style transfer typically operates on 2D images, making stylization of a mesh challenging. When optimized over a variety of poses, stylization patterns become stretched out and inconsistent in size. On the other hand, model-based 3D style transfer methods exist that allow stylization from a sparse set of images, but they require a network at inference time. To this end, we optimize an explicit texture for the reconstructed mesh of a scene and stylize it jointly from all available input images. Our depth- and angle-aware optimization leverages surface normal and depth data of the underlying mesh to create a uniform and consistent stylization for the whole scene. Our experiments show that our method creates sharp and detailed results for the complete scene without view-dependent artifacts. Through extensive ablation studies, we show that the proposed 3D awareness enables style transfer to be applied to the 3D domain of a mesh. Our method can be used to render a stylized mesh in real-time with traditional rendering pipelines.


title: The MAIEI Learning Community Report

abstract: This is a labor of the Learning Community cohort that was convened by MAIEI in Winter 2021 to work through and discuss important research issues in the field of AI ethics from a multidisciplinary lens. The community came together supported by facilitators from the MAIEI staff to vigorously debate and explore the nuances of issues like bias, privacy, disinformation, accountability, and more especially examining them from the perspective of industry, civil society, academia, and government. The outcome of these discussions is reflected in the report that you are reading now - an exploration of a variety of issues with deep-dive, critical commentary on what has been done, what worked and what didn't, and what remains to be done so that we can meaningfully move forward in addressing the societal challenges posed by the deployment of AI systems. The chapters titled "Design and Techno-isolationism", "Facebook and the Digital Divide: Perspectives from Myanmar, Mexico, and India", "Future of Work", and "Media & Communications & Ethical Foresight" will hopefully provide with you novel lenses to explore this domain beyond the usual tropes that are covered in the domain of AI ethics.


title: Polarization-path-frequency entanglement using interferometry and frequency shifters

abstract: Higher dimensional Hilbert space along with ability to control multiple degrees of freedom of photon and entangle them has enabled new quantum protocols for various quantum information processing applications. Here, we propose a scheme to generate and control polarization-path frequency entanglement using the operative elements required to implement a polarization-controlled quantum walk in the path(position) space and frequency domain. Hyperentangled states manifests in the controlled dynamics using an interferometric setup where half-wave plates, beam-splitters and frequency shifters such as those based on the electro-optic effect are used to manipulate the polarization, path and frequency degrees of freedom respectively. The emphasis is on utilizing the polarization to influence the movement to a specific value in the frequency and position space. Negativity between the subspaces is calculated to demonstrate the controllability of the entanglement between them. Progress reported with experimental demonstration of realization of quantum walk using quantum states of light makes quantum walks a practical approach to generate hyperentangled states.