title: Mirror modular cloning and fast quantum associative retrieval

abstract: We show that a quantum state can be perfectly cloned up to global mirroring with a unitary transformation that depends on one single parameter. We then show that this is equivalent to "perfect" cloning for quantum associative memories which, as a consequence efficiently hold exponentially more information than their classical counterparts. Finally, we present a quantum associative retrieval algorithm which can correct corrupted inputs and is exponentially faster than the Grover algorithm.


title: Clustering Trust Dynamics in a Human-Robot Sequential Decision-Making Task

abstract: In this paper, we present a framework for trust-aware sequential decision-making in a human-robot team. We model the problem as a finite-horizon Markov Decision Process with a reward-based performance metric, allowing the robotic agent to make trust-aware recommendations. Results of a human-subject experiment show that the proposed trust update model is able to accurately capture the human agent's moment-to-moment trust changes. Moreover, we cluster the participants' trust dynamics into three categories, namely, Bayesian decision makers, oscillators, and disbelievers, and identify personal characteristics that could be used to predict which type of trust dynamics a person will belong to. We find that the disbelievers are less extroverted, less agreeable, and have lower expectations toward the robotic agent, compared to the Bayesian decision makers and oscillators. The oscillators are significantly more frustrated than the Bayesian decision makers.


title: Integrating Prior Knowledge in Contrastive Learning with Kernel

abstract: Data augmentation is a crucial component in unsupervised contrastive learning (CL). It determines how positive samples are defined and, ultimately, the quality of the learned representation. In this work, we open the door to new perspectives for CL by integrating prior knowledge, given either by generative models -- viewed as prior representations -- or weak attributes in the positive and negative sampling. To this end, we use kernel theory to propose a novel loss, called decoupled uniformity, that i) allows the integration of prior knowledge and ii) removes the negative-positive coupling in the original InfoNCE loss. We draw a connection between contrastive learning and conditional mean embedding theory to derive tight bounds on the downstream classification loss. In an unsupervised setting, we empirically demonstrate that CL benefits from generative models to improve its representation both on natural and medical images. In a weakly supervised scenario, our framework outperforms other unconditional and conditional CL approaches.


title: Wake and aeroelasticity of a flexible pitching foil

abstract: A flexible foil undergoing pitching oscillations is studied experimentally in a wind tunnel with different imposed free stream velocities. The chord-based Reynolds number is in the range 1600--4000, such that the dynamics of the system is governed by inertial forces and the wake behind the foil exhibits the reverse B\'enard-von K\'arm\'an vortex street characteristic of flapping-based propulsion. Particle Image Velocimetry (PIV) measurements are performed to examine the flow around the foil, whilst the deformation of the foil is also tracked. The first natural frequency of vibration of the foil is within the range of flapping frequencies explored, determining a strongly-coupled dynamics between the elastic foil deformation and the vortex shedding. Cluster-based reduced order modelling is applied on the PIV data in order to identify the coherent flow structures. Analysing the foil kinematics and using a control-volume calculation of the average drag forces from the corresponding velocity fields, we determine the optimal flapping configurations for thrust generation. We show that propulsive force peaks occur at dimensionless frequencies shifted with respect to the elastic resonances that are marked by maximum trailing edge oscillation amplitudes. The thrust peaks are better explained by a wake resonance, which we examine using the tools of classic hydrodynamic stability on the mean propulsive jet profiles.


title: Synthesis of an aqueous, air-stable, superconducting 1T'-WS$_2$ monolayer-ink

abstract: Liquid-phase chemical exfoliation is ideal to achieve industry scale production of two-dimensional (2D) materials for a wide range of application such as printable electronics, catalysis and energy storage. However, many impactful 2D materials with potentials in quantum technologies can only be studied in lab settings due to their air-sensitivity, and loss of physical performance after chemical processing. Here, we report a simple chemical exfoliation method to create a stable, aqueous, surfactant-free, superconducting ink containing phase-pure 1T'-WS$_2$ monolayers that are isotructural to the air-sensitive topological insulator 1T'-WTe$_2$. We demonstrate that thin films can be cast on both hard and flexible substrates. The printed film is metallic at room temperature and superconducting below 7.3 K, shows strong anisotropic unconventional superconducting behavior with an in-plane and out-of-plane upper critical magnetic field of 30.1 T and 5.3 T, has a critical current of 44 mA, and is stable at ambient conditions for at least 30 days. Our results show that chemical processing can provide an engineering solution, which makes non-trivial 2D materials that used to be only studied in laboratories commercially accessible.


title: Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules

abstract: Neural ordinary differential equations (ODEs) have attracted much attention as continuous-time counterparts of deep residual neural networks (NNs), and numerous extensions for recurrent NNs have been proposed. Since the 1980s, ODEs have also been used to derive theoretical results for NN learning rules, e.g., the famous connection between Oja's rule and principal component analysis. Such rules are typically expressed as additive iterative update processes which have straightforward ODE counterparts. Here we introduce a novel combination of learning rules and Neural ODEs to build continuous-time sequence processing nets that learn to manipulate short-term memory in rapidly changing synaptic connections of other nets. This yields continuous-time counterparts of Fast Weight Programmers and linear Transformers. Our novel models outperform the best existing Neural Controlled Differential Equation based models on various time series classification tasks, while also addressing their fundamental scalability limitations. Our code is public.


title: Greater than 5 Percent Compressive Strain in Graphene via the Self Rolled up Membrane Platform

abstract: Graphene is an atomically thin metallic membrane capable of sustaining reversible strain and offers a tempting prospect of controlling its optoelectronic properties via strain. Graphenes exceptional mechanical flexibility and tensile strength provide a lot of room for strain engineering. Here we use the self-rolled-up membrane platform for strain engineering and integration of graphene with stressed dielectric thin films. Graphene rolls up or down together with the stressed film upon releasing from the substrate and the curvature of the rolled-up film stack enables the strain tuning of the graphene monolayer. Raman spectroscopy was used to characterize the uniaxial strain in rolled up graphene by quantifying the red shift and splitting of the G peak in the doubly degenerate E2g optical mode. Approximately 5 percent compressive strain is realized using a SRuM diameter of roughly 2 microns. By reducing the diameter of the SRuM structure, even higher strain level can be reached. The SRuM approach can also be readily applied to induce strain in other materials beyond the level that can be achieved using conventional approaches.


title: D'ARTAGNAN: Counterfactual Video Generation

abstract: Causally-enabled machine learning frameworks could help clinicians to identify the best course of treatments by answering counterfactual questions. We explore this path for the case of echocardiograms by looking into the variation of the Left Ventricle Ejection Fraction, the most essential clinical metric gained from these examinations. We combine deep neural networks, twin causal networks and generative adversarial methods for the first time to build D'ARTAGNAN (Deep ARtificial Twin-Architecture GeNerAtive Networks), a novel causal generative model. We demonstrate the soundness of our approach on a synthetic dataset before applying it to cardiac ultrasound videos to answer the question: "What would this echocardiogram look like if the patient had a different ejection fraction?". To do so, we generate new ultrasound videos, retaining the video style and anatomy of the original patient, while modifying the Ejection Fraction conditioned on a given input. We achieve an SSIM score of 0.79 and an R2 score of 0.51 on the counterfactual videos. Code and models are available at: https://github.com/HReynaud/dartagnan.


title: Fundamentals of RIS-Aided Localization in the Far-Field

abstract: This paper develops fundamental bounds for localization in orthogonal frequency division multiplexing (OFDM) systems aided by reconfigurable intelligent surfaces (RISs). Specifically, we start from the assumption that the position and orientation of a RIS can be viewed as prior information for RIS-aided localization in wireless systems and derive Bayesian bounds for the localization of a user equipment (UE). To do this, we first derive the Bayesian Fisher information matrix (FIM) for channel parameters to derive the Bayesian localization bounds. Then, to focus on the geometric channel parameters, we derive the equivalent Fisher information matrix (EFIM) and show that it has a definite structure. Subsequently, we show through the information loss associated with the EFIM that when the RIS reflection coefficients remain constant across all OFDM symbols, and there is no prior information about the nuisance parameters, the corresponding submatrix in the EFIM related to the RIS angle parameters is a zero matrix. As a result of the EFIM being a zero matrix, estimating the RIS-related angle channel parameters is not possible when the RIS reflection coefficients remain constant across all OFDM symbols. This observation is crucial for the estimation of the RIS-related angle parameters. It dictates that to estimate the RIS-related angle parameters, there must be more than one OFDM transmission with differing RIS reflection coefficients.


title: Metrics reloaded: Recommendations for image analysis validation

abstract: Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen performance metrics often do not reflect the domain interest, thus failing to adequately measure scientific progress and hindering translation of ML techniques into practice. To overcome this, our large international expert consortium created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. The framework was developed in a multi-stage Delphi process and is based on the novel concept of a problem fingerprint - a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), data set and algorithm output. Based on the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as a classification task at image, object or pixel level, namely image-level classification, object detection, semantic segmentation, and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool, which also provides a point of access to explore weaknesses, strengths and specific recommendations for the most common validation metrics. The broad applicability of our framework across domains is demonstrated by an instantiation for various biological and medical image analysis use cases.


title: Finitely additive mass transportation

abstract: Some classical mass transportation problems are investigated in a finitely additive setting. Let $\Omega=\prod_{i=1}^n\Omega_i$ and $\mathcal{A}=\otimes_{i=1}^n\mathcal{A}_i$, where $(\Omega_i,\mathcal{A}_i,\mu_i)$ is a ($\sigma$-additive) probability space for $i=1,\ldots,n$. Let $c:\Omega\rightarrow [0,\infty]$ be an $\mathcal{A}$-measurable cost function. Let $M$ be the collection of finitely additive probabilities on $\mathcal{A}$ with marginals $\mu_1,\ldots,\mu_n$. If couplings are meant as elements of $M$, most classical results of mass transportation theory, including duality and attainability of the Kantorovich inf, are valid without any further assumptions. Special attention is devoted to martingale transport. Let $(\Omega_i,\mathcal{A}_i)=(\mathbb{R},\mathcal{B}(\mathbb{R}))$ for all $i$ and $$M_1=\bigl\{P\in M:P\ll P^*\text{ and }(\pi_1,\ldots,\pi_n)\text{ is a }P\text{-martingale}\}$$ where $P^*$ is a reference probability on $\mathcal{A}$. If $M_1\ne\emptyset$, then $$\int c\,dP=\inf_{Q\in M_1}\int c\,dQ\quad\quad\text{for some }P\in M_1.$$ Conditions for $M_1\ne\emptyset$ are given as well.


title: Open Frobenius cluster tilted algebras

abstract: In this paper, we compute the Frobenius dimension of any cluster tilted algebra of finite type. Moreover, we give conditions on the bounded quiver of a cluster tilted algebra $\Lambda$ such that $\Lambda$ has non-trivial open Frobenius structures.


title: Emergence of Kac-Moody Symmetry in Critical Quantum Spin Chains

abstract: Given a critical quantum spin chain with a microscopic Lie-group symmetry, corresponding e.g. to $U(1)$ or $SU(2)$ spin isotropy, we numerically investigate the emergence of Kac-Moody symmetry at low energies and long distances. In that regime, one such critical quantum spin chain is described by a conformal field theory where the usual Virasoro algebra associated to conformal invariance is augmented with a Kac-Moody algebra associated to conserved currents. Specifically, we first propose a method to construct lattice operators corresponding to the Kac-Moody generators. We then numerically show that, when projected onto low energy states of the quantum spin chain, these operators indeed approximately fulfill the Kac-Moody algebra. The lattice version of the Kac-Moody generators allow us to compute the so-called level constant and to organize the low-energy eigenstates of the lattice Hamiltonian into Kac-Moody towers. We illustrate the proposal with the XXZ model and the Heisenberg model with a next-to-nearest-neighbor coupling.


title: A unifying framework for tangential interpolation of structured bilinear control systems

abstract: In this paper, we consider the structure-preserving model order reduction problem for multi-input/multi-output bilinear control systems by tangential interpolation. We propose a new type of tangential interpolation problem for structured bilinear systems, for which we develop a new structure-preserving interpolation framework. This new framework extends and generalizes different formulations of tangential interpolation for bilinear systems from the literature and also provides a unifying framework. We then derive explicit conditions on the projection spaces to enforce tangential interpolation in different settings, including conditions for tangential Hermite interpolation. The analysis is illustrated by means of three numerical examples.

categories: math.NA cs.NA cs.SY eess.SY math.DS math.OC


title: Identification via Retinal Vessels Combining LBP and HOG

abstract: With development of information technology and necessity for high security, using different identification methods has become very important. Each biometric feature has its own advantages and disadvantages and choosing each of them depends on our usage. Retinal scanning is a bio scale method for identification. The retina is composed of vessels and optical disk. The vessels distribution pattern is one the remarkable retinal identification methods. In this paper, a new approach is presented for identification via retinal images using LBP and hog methods. In the proposed method, it will be tried to separate the retinal vessels accurately via machine vision techniques which will have good sustainability in rotation and size change. HOG-based or LBP-based methods or their combination can be used for separation and also HSV color space can be used too. Having extracted the features, the similarity criteria can be used for identification. The implementation of proposed method and its comparison with one of the newly-presented methods in this area shows better performance of the proposed method.


title: Accurate collection of reasons for treatment discontinuation to better define estimands in clinical trials

abstract: Background: Reasons for treatment discontinuation are important not only to understand the benefit and risk profile of experimental treatments, but also to help choose appropriate strategies to handle intercurrent events in defining estimands. The current case report form (CRF) commonly in use mixes the underlying reasons for treatment discontinuation and who makes the decision for treatment discontinuation, often resulting in an inaccurate collection of reasons for treatment discontinuation. Methods and results: We systematically reviewed and analyzed treatment discontinuation data from nine phase 2 and phase 3 studies for insulin peglispro. A total of 857 participants with treatment discontinuation were included in the analysis. Our review suggested that, due to the vague multiple-choice options for treatment discontinuation present in the CRF, different reasons were sometimes recorded for the same underlying reason for treatment discontinuation. Based on our review and analysis, we suggest an intermediate solution and a more systematic way to improve the current CRF for treatment discontinuations. Conclusion: This research provides insight and directions on how to optimize the CRF for recording treatment discontinuation. Further work needs to be done to build the learning into Clinical Data Interchange Standards Consortium standards.


title: L1-norm vs. L2-norm fitting in optimizing focal multi-channel tES stimulation: linear and semidefinite programming vs. weighted least squares

abstract: This study focuses on Multi-Channel Transcranial Electrical Stimulation, a non-invasive brain method for stimulating neuronal activity under the influence of low-intensity currents. We introduce mathematical formulation for finding a current pattern which optimizes a L1-norm fit between a given focal target distribution and volume current density inside the brain. L1-norm is well-known to favor well-localized or sparse distributions compared to L2-norm (least-squares) fitted estimates. We present a linear programming approach which performs L1-norm fitting and penalization of the current pattern (L1L1) to control the number of non-zero currents. The optimizer filters a large set of candidate solutions using a two-stage metaheuristic search in from a pre-filtered set of candidates. The numerical simulation results, obtained with both a 8- and 20-channel electrode montages, suggest that our hypothesis on the benefits of L1-norm data fitting is valid. As compared to L1-norm regularized L2-norm fitting (L1L2) via semidefinite programming and weighted Tikhonov least-squares method, the L1L1 results were overall preferable with respect to maximizing the focused current density at the target position and the ratio between focused and nuisance current magnitudes. We propose the metaheuristic L1L1 optimization approach as a potential technique to obtain a well-localized stimulus with a controllable magnitude at a given target position. L1L1 finds a current pattern with a steep contrast between the anodal and cathodal electrodes meanwhile suppressing the nuisance currents in the brain, hence, providing a potential alternative to modulate the effects of the stimulation, e.g., the sensation experienced by the subject.


title: Style-Content Disentanglement in Language-Image Pretraining Representations for Zero-Shot Sketch-to-Image Synthesis

abstract: In this work, we propose and validate a framework to leverage language-image pretraining representations for training-free zero-shot sketch-to-image synthesis. We show that disentangled content and style representations can be utilized to guide image generators to employ them as sketch-to-image generators without (re-)training any parameters. Our approach for disentangling style and content entails a simple method consisting of elementary arithmetic assuming compositionality of information in representations of input sketches. Our results demonstrate that this approach is competitive with state-of-the-art instance-level open-domain sketch-to-image models, while only depending on pretrained off-the-shelf models and a fraction of the data.


title: SN 2020wnt: a slow-evolving carbon-rich superluminous supernova with no O II lines and a bumpy light curve

abstract: We present the analysis of SN 2020wnt, an unusual hydrogen-poor super-luminous supernova (SLSN-I), at a redshift of 0.032. The light curves of SN 2020wnt are characterised by an early bump lasting $\sim5$ days, followed by a bright main peak. The SN reaches a peak absolute magnitude of M$_{r}^{max}=-20.52\pm0.03$ mag at $\sim77.5$ days from explosion. This magnitude is at the lower end of the luminosity distribution of SLSNe-I, but the rise-time is one of the longest reported to date. Unlike other SLSNe-I, the spectra of SN 2020wnt do not show O II, but strong lines of C II and Si II are detected. Spectroscopically, SN 2020wnt resembles the Type Ic SN 2007gr, but its evolution is significantly slower. Comparing the bolometric light curve to hydrodynamical models, we find that SN 2020wnt luminosity can be explained by radioactive powering. The progenitor of SN 2020wnt is likely a massive and extended star with a pre-SN mass of 80 M$_\odot$ and a pre-SN radius of 15 R$_\odot$ that experiences a very energetic explosion of $45\times10^{51}$ erg, producing 4 M$_\odot$ of $^{56}$Ni. In this framework, the first peak results from a post-shock cooling phase for an extended progenitor, and the luminous main peak is due to a large nickel production. These characteristics are compatible with the pair-instability SN scenario. We note, however, that a significant contribution of interaction with circumstellar material cannot be ruled out.


title: Joint Energy Dispatch and Unit Commitment in Microgrids Based on Deep Reinforcement Learning

abstract: Nowadays, the application of microgrids (MG) with renewable energy is becoming more and more extensive, which creates a strong need for dynamic energy management. In this paper, deep reinforcement learning (DRL) is applied to learn an optimal policy for making joint energy dispatch (ED) and unit commitment (UC) decisions in an isolated MG, with the aim for reducing the total power generation cost on the premise of ensuring the supply-demand balance. In order to overcome the challenge of discrete-continuous hybrid action space due to joint ED and UC, we propose a DRL algorithm, i.e., the hybrid action finite-horizon DDPG (HAFH-DDPG), that seamlessly integrates two classical DRL algorithms, i.e., deep Q-network (DQN) and deep deterministic policy gradient (DDPG), based on a finite-horizon dynamic programming (DP) framework. Moreover, a diesel generator (DG) selection strategy is presented to support a simplified action space for reducing the computation complexity of this algorithm. Finally, the effectiveness of our proposed algorithm is verified through comparison with several baseline algorithms by experiments with real-world data set.


title: Inducing oscillations of trapped particles in a near-critical Gaussian field

abstract: We study the nonequilibrium dynamics of two particles confined in two spatially separated harmonic potentials and linearly coupled to the same thermally fluctuating scalar field, a cartoon for optically trapped colloids in contact with a medium close to a continuous phase transition. When an external periodic driving is applied to one of these particles, a nonequilibrium periodic state is eventually reached in which their motion synchronizes thanks to the field-mediated effective interaction, a phenomenon already observed in experiments. We fully characterize the nonlinear response of the second particle as a function of the driving frequency, and in particular far from the adiabatic regime in which the field can be assumed to relax instantaneously. We compare the perturbative, analytic solution to its adiabatic approximation, thus determining the limits of validity of the latter, and we qualitatively test our predictions against numerical simulations.


title: BaCaDI: Bayesian Causal Discovery with Unknown Interventions

abstract: Inferring causal structures from experimentation is a central task in many domains. For example, in biology, recent advances allow us to obtain single-cell expression data under multiple interventions such as drugs or gene knockouts. However, the targets of the interventions are often uncertain or unknown and the number of observations limited. As a result, standard causal discovery methods can no longer be reliably used. To fill this gap, we propose a Bayesian framework (BaCaDI) for discovering and reasoning about the causal structure that underlies data generated under various unknown experimental or interventional conditions. BaCaDI is fully differentiable, which allows us to infer the complex joint posterior over the intervention targets and the causal structure via efficient gradient-based variational inference. In experiments on synthetic causal discovery tasks and simulated gene-expression data, BaCaDI outperforms related methods in identifying causal structures and intervention targets.


title: Algorithm for Constrained Markov Decision Process with Linear Convergence

abstract: The problem of constrained Markov decision process is considered. An agent aims to maximize the expected accumulated discounted reward subject to multiple constraints on its costs (the number of constraints is relatively small). A new dual approach is proposed with the integration of two ingredients: entropy regularized policy optimizer and Vaidya's dual optimizer, both of which are critical to achieve faster convergence. The finite-time error bound of the proposed approach is provided. Despite the challenge of the nonconcave objective subject to nonconcave constraints, the proposed approach is shown to converge (with linear rate) to the global optimum. The complexity expressed in terms of the optimality gap and the constraint violation significantly improves upon the existing primal-dual approaches.


title: $Q$-spaces, perfect spaces and related cardinal characteristics of the continuum

abstract: A topological space $X$ is called a $Q$-space if every subset of $X$ is of type $F_\sigma$ in $X$. For $i\in\{1,2,3\}$ let $\mathfrak q_i$ be the smallest cardinality of a second-countable $T_i$-space which is not a $Q$-space. It is clear that $\mathfrak q_1\le\mathfrak q_2\le\mathfrak q_3$. For $i\in\{1,2\}$ we prove that $\mathfrak q_i$ is equal to the smallest cardinality of a second-countable $T_i$-space which is not perfect. Also we prove that $\mathfrak q_3$ is equal to the smallest cardinality of a submetrizable space, which is not a $Q$-space. Martin's Axiom implies that $\mathfrak q_i=\mathfrak c$ for all $i\in\{1,2,3\}$.


title: Yangian Symmetry in Five Dimensions

abstract: Quantum gravity in AdS$_7 \times$S$^4$ is dual to a 6d superconformal field theory, known as the 6d $(2,0)$ theory, which is very challenging to describe because it lacks a conventional Lagrangian description. On the other hand, certain null reductions of the 6d $(2,0)$ theory give rise to 5d Lagrangian theories with $SU(1,3)$ spacetime symmetry, $SO(5)$ R-symmetry, and 24 supercharges. This appears to be closely related to the superconformal group of a 3d superconformal Chern-Simons theory known as the ABJM theory, which is believed to be integrable in the planar limit, if one exchanges the role of conformal and R-symmetry. In this note, we construct a representation of the 5d superconformal group using 6d supertwistors and show that it admits an infinite dimensional extension known as Yangian symmetry, which opens up the possiblity that these 5d theories are exactly solvable in the planar limit.


title: Relating plasticity to dislocation properties by data analysis: scaling vs. machine learning approaches

abstract: Plasticity modelling has long been based on phenomenological models based on ad-hoc assuption of constitutive relations, which are then fitted to limited data. Other work is based on the consideration of physical mechanisms which seek to establish a physical foundation of the observed plastic deformation behavior through identification of isolated defect processes ('mechanisms') which are observed either experimentally or in simulations and then serve to formulate so-called physically based models. Neither of these approaches is adequate to capture the complexity of plastic deformation which belongs into the realm of emergent collective phenomena, and to understand the complex interplay of multiple deformation pathways which is at the core of modern high performance structural materials. Data based approaches offer alternative pathways towards plasticity modelling whose strengths and limitations we explore here for a simple example, namely the interplay between rate and dislocation density dependent strengthening mechanisms in fcc metals.


title: Egocentric Video-Language Pretraining

abstract: Video-Language Pretraining (VLP), which aims to learn transferable representation to advance a wide range of video-text downstream tasks, has recently received increasing attention. Best performing works rely on large-scale, 3rd-person video-text datasets, such as HowTo100M. In this work, we exploit the recently released Ego4D dataset to pioneer Egocentric VLP along three directions. (i) We create EgoClip, a 1st-person video-text pretraining dataset comprising 3.8M clip-text pairs well-chosen from Ego4D, covering a large variety of human daily activities. (ii) We propose a novel pretraining objective, dubbed EgoNCE, which adapts video-text contrastive learning to the egocentric domain by mining egocentric-aware positive and negative samples. (iii) We introduce EgoMCQ, a development benchmark that is close to EgoClip and hence can support effective validation and fast exploration of our design decisions in EgoClip and EgoNCE. Furthermore, we demonstrate strong performance on five egocentric downstream tasks across three datasets: video-text retrieval on EPIC-KITCHENS-100; action recognition on Charades-Ego; natural language query, moment query, and object state change classification on Ego4D challenge benchmarks. The dataset and code are available at https://github.com/showlab/EgoVLP.


title: On symmetrizability and perfectness of second-countable spaces

abstract: A symmetrizability criterion of Arhangelskii implies that a second-countable Hausdorff space is symmetrizable if and only if it is perfect. We present an example of a non-symmetrizable second-countable submetrizable space of cardinality $\mathfrak q_0$ and study the smallest possible cardinality $\mathfrak q_i$ of a non-symmetrizable second-countable $T_i$-space for $i\in\{1,2\}$.


title: Correspondence between factorability and normalisation in monoids

abstract: Abstract. This article determines relations between two notions concerning monoids: factorability structure, introduced to simplify the bar complex; and quadratic normalisation, introduced to generalise quadratic rewriting systems and normalisations arising from Garside families. Factorable monoids are characterised in the axiomatic setting of quadratic normalisations. Additionally, quadratic normalisations of class (4,3) are characterised in terms of factorability structures and a condition ensuring the termination of the associated rewriting system.


title: Protoneutron Star Convection Simulated with a New General Relativistic Boltzmann Neutrino Radiation-Hydrodynamics Code

abstract: We investigate the protoneutron star (PNS) convection using our newly developed general relativistic Boltzmann neutrino radiation-hydrodynamics code. This is a pilot study for more comprehensive investigations later. As such, we take a snapshot of a PNS at 2.3 seconds after bounce from a 1D PNS cooling calculation and run our simulation for $\sim160\,\mathrm{ms}$ in 2D under axisymmetry. The original PNS cooling calculation neglected convection entirely and the initial condition is linearly unstable to convection. We find in our 2D simulation that convection is instigated there indeed and expands inward after being full-fledged. The convection is then settled to a quasi-steady state in $\sim100\,\mathrm{ms}$, being sustained by the negative $Y_e$ gradient, which is in turn maintained by neutrino emissions. It enhances the luminosities and mean energies of all species of neutrinos compared to 1D. Taking advantage of the Boltzmann solver, we analyze the possible occurrence of the neutrino fast flavor conversion (FFC). We found that FFC is likely to occur in the regions, where $Y_e$ is lower, and that the growth rate can be as high as $\sim 10^{-1}\,{\mathrm{cm}^{-1}}$.


title: On interplay between flavour anomalies and neutrino properties

abstract: A minimal extension of the Standard Model (SM) featuring two scalar leptoquarks, an SU(2) doublet with hypercharge 1/6 and a singlet with hypercharge 1/3, is proposed as an economical benchmark model for studies of an interplay between flavour physics and properties of the neutrino sector. The presence of such type of leptoquarks radiatively generates neutrino masses and offers a simultaneous explanation for the current B-physics anomalies involving $b \to c \ell \nu_\ell$ decays. The model can also accommodate both the muon magnetic moment and the recently reported $W$ mass anomalies, while complying with the most stringent lepton flavour violating observables.


title: Multi-Stage Decision Rules for Power Generation & Storage Investments with Performance Guarantees

abstract: We develop multi-stage linear decision rules (LDRs) for dynamic power system generation and energy storage investment planning under uncertainty and propose their chance-constrained optimization with performance guarantees. First, the optimized LDRs guarantee operational and carbon policy feasibility of the resulting dynamic investment plan even when the planning uncertainty distribution is ambiguous. Second, the optimized LDRs internalize the tolerance of the system planner towards the stochasticity (variance) of uncertain investment outcomes. They can eventually produce a quasi-deterministic investment plan, which is insensitive to uncertainty (as in deterministic planning) but robust to its realizations (as in stochastic planning). Last, we certify the performance of the optimized LDRs with the bound on their sub-optimality due to their linear functional form. Using this bound, we guarantee that the preference of LDRs over less restrictive -- yet poorly scalable -- scenario-based optimization does not lead to financial losses exceeding this bound. We use a testbed of the U.S. Southeast power system to reveal the trade-offs between the cost, stochasticity, and feasibility of LDR-based investments. We also conclude that the LDR sub-optimality depends on the amount of uncertainty and the tightness of chance constraints on operational, investment and policy variables.


title: Ultrafast laser pulse characterization by THG d-scan using optically enhanced graphene coatings

abstract: We have successfully functionalized 5 layers of TCVD-grown graphene by photoassisted transfer hydrogenation reaction with formic acid, in order to increase its nonlinear optical response and laser-induced damage resilience. Using the functionalized graphene samples, we were able to fully characterize sub-10 fs ultrashort laser pulses using THG dispersion-scan, with results that are in excellent agreement with the ones obtained with pristine graphene samples.


title: ArgRewrite V.2: an Annotated Argumentative Revisions Corpus

abstract: Analyzing how humans revise their writings is an interesting research question, not only from an educational perspective but also in terms of artificial intelligence. Better understanding of this process could facilitate many NLP applications, from intelligent tutoring systems to supportive and collaborative writing environments. Developing these applications, however, requires revision corpora, which are not widely available. In this work, we present ArgRewrite V.2, a corpus of annotated argumentative revisions, collected from two cycles of revisions to argumentative essays about self-driving cars. Annotations are provided at different levels of purpose granularity (coarse and fine) and scope (sentential and subsentential). In addition, the corpus includes the revision goal given to each writer, essay scores, annotation verification, pre- and post-study surveys collected from participants as meta-data. The variety of revision unit scope and purpose granularity levels in ArgRewrite, along with the inclusion of new types of meta-data, can make it a useful resource for research and applications that involve revision analysis. We demonstrate some potential applications of ArgRewrite V.2 in the development of automatic revision purpose predictors, as a training source and benchmark.


title: Toward a Sensitivity-based Implicit Measure of Patients' Important Goal Pursuits

abstract: When individuals arrive to receive help from mental health providers, they do not always have well specified and well established goals. It is the mental health providers responsibility to work collaboratively with patients to clarify their goals in the therapy sessions as well as life in general through clinical interviews, diagnostic assessments, and thorough observations. However, recognizing individuals important life goals is not always straightforward. Here we introduce a novel method that gauges a patient important goal pursuits from their relative sensitivity to goal related words. Past research has shown that a person active goal pursuits cause them to be more sensitive to the presence of goal related stimuli in the environment being able to consciously report those stimuli when others cannot see them. By presenting words related to a variety of different life goal pursuits very quickly for 50 msec or less, the patient would be expected to notice and be aware of words related to their strongest motivations but not the other goal related words. These may or may not be among the goals they have identified in therapy sessions, and the ones not previously identified can be fertile grounds for further discussion and exploration in subsequent therapy sessions. Results from eight patient volunteers are described and discussed in terms of the potential utility of this supplemental personal therapy aid.


title: Compactness in the Thermal Evolution of Twin Stars

abstract: In this work, we study for the first time the thermal evolution of twin star pairs, i.e., stars that present the same mass but different radius and compactness. We collect available equations of state that give origin to a second branch of stable compact stars with quarks in their core. For each equation of state, we investigate the particle composition inside stars and how differently each twin evolves over time, which depends on the central density/pressure and consequent crossing of the threshold for the Urca cooling process. We find that, although the general stellar thermal evolution depends on mass and particle composition, withing one equation of state, only twin pairs that differ considerably on compactness can be clearly distinguished by how they cool down.


title: Structuring the local handedness of synthetic chiral light: global chirality versus polarization of chirality

abstract: Synthetic chiral light enables ultrafast and highly efficient imaging of molecular chirality. Unlike standard circularly polarized light, the handedness of synthetic chiral light does not rely on the spatial structure of the light field: it is encoded locally, in the chiral trajectory that the tip of the electric-field vector draws in time, at each point in space. Being locally chiral, already within the electric-dipole approximation, synthetic chiral light is a highly efficient chiral photonic reagent. Synthetic chiral light that is locally and globally chiral allows us to selectively quench the nonlinear response of a selected molecular enantiomer while maximizing it in its mirror twin at the level of total signal intensities. Synthetic chiral light that exhibits polarization of chirality allows us to realize a chiral version of Young's double-slit experiment that leads to enantio-sensitive light bending. Here we connect these two new concepts and show how one can structure the local and global handedness of synthetic chiral light in space, and how these local and global properties are imprinted in the enantio-sensitive response of the chiral molecules, creating new opportunities for ultrafast, all-optical and highly efficient imaging of molecular chirality.


title: SYZ mirror symmetry for del Pezzo surfaces and affine structures

abstract: We prove that the Landau--Ginzburg superpotential of del Pezzo surfaces can be realized as a limit of their hyperK\"ahler rotation toward the large complex structure limit point. As a corollary, we compute the limit of the complex affine structure of the special Lagrangian fibrations constructed by Collins--Jacob--Lin in $\mathbf{P}^1\times \mathbf{P}^1$ arXiv:1904.08363 and compare it with the integral affine structures used in the work of Carl--Pumperla--Siebert arXiv:2205.07753. We also construct the Floer-theoretical Landau--Ginzburg mirrors of smoothing of $A_n$-singularities and monotone del Pezzo surfaces, by using the gluing method of Cho--Hong--Lau arXiv:1810.02045 and Hong--Kim--Lau arXiv:1805.11738. They agree with the result of hyperK\"ahler rotation.


title: Probability distribution for black hole evaporation

abstract: Non-thermal correction to the emission probability of particles from black holes can be obtained if the backreaction or self-gravitational effects of the emitted particles on the black hole spacetime are taken into consideration. These non-thermally emitted particles conserve the entropy of the black hole, i.e, the entropy of the system of radiated particles after complete evaporation of the black hole matches the initial entropy of the black hole. Using the non-thermal emission probability, we have determined the probability for a black hole of mass $M$ to be completely evaporated by a given number of particles $n$. This is done by first evaluating the number of possible ways in which the black hole can be evaporated by emitting $n$ number of particles, and then the total number of ways in which the black hole can be evaporated. The ratio of these two quantities gives us the desired probability. From the probability distribution, we get a displacement relation between the most probable number of particles exhausting the black hole and the temperature of the initial black hole. This relation resembles Wien's displacement law for blackbody radiation.


title: FishGym: A High-Performance Physics-based Simulation Framework for Underwater Robot Learning

abstract: Bionic underwater robots have demonstrated their superiority in many applications. Yet, training their intelligence for a variety of tasks that mimic the behavior of underwater creatures poses a number of challenges in practice, mainly due to lack of a large amount of available training data as well as the high cost in real physical environment. Alternatively, simulation has been considered as a viable and important tool for acquiring datasets in different environments, but it mostly targeted rigid and soft body systems. There is currently dearth of work for more complex fluid systems interacting with immersed solids that can be efficiently and accurately simulated for robot training purposes. In this paper, we propose a new platform called "FishGym", which can be used to train fish-like underwater robots. The framework consists of a robotic fish modeling module using articulated body with skinning, a GPU-based high-performance localized two-way coupled fluid-structure interaction simulation module that handles both finite and infinitely large domains, as well as a reinforcement learning module. We leveraged existing training methods with adaptations to underwater fish-like robots and obtained learned control policies for multiple benchmark tasks. The training results are demonstrated with reasonable motion trajectories, with comparisons and analyses to empirical models as well as known real fish swimming behaviors to highlight the advantages of the proposed platform.


title: HashBeam: Enabling Feedback Through Downlink Beamforming in Unsourced Random Access

abstract: Unsourced random access (URA) has emerged as a candidate paradigm for massive machine-type communication (MTC) in next-generation wireless networks. While many excellent uplink schemes have been developed for URA, these schemes do not specify a mechanism for providing feedback regarding whether a user's message was successfully decoded. While this may be acceptable in some MTC scenarios, the lack of feedback is inadequate for applications that demand a high level of reliability. However, the problem of providing feedback to active users is complicated by the fact that the base station does not know the identities of the active users. In this paper, a novel downlink beamforming scheme called HashBeam is presented that enables the base station to provide feedback to the active users within URA, despite not knowing their identities. The key idea of this scheme is that the users' channels and hashes of their messages may be used as proxies for their true identities. The proposed scheme may be adapted to any number of antennas at the base station and it is shown that the required number of channel uses is linear in the number of users to acknowledge. The idea of using channel gains in conjunction with user hashes as discriminating attributes of active users is novel and expands the design space of URA schemes.


title: Toward a realistic model of speech processing in the brain with self-supervised learning

abstract: Several deep neural networks have recently been shown to generate activations similar to those of the brain in response to the same input. These algorithms, however, remain largely implausible: they require (1) extraordinarily large amounts of data, (2) unobtainable supervised labels, (3) textual rather than raw sensory input, and / or (4) implausibly large memory (e.g. thousands of contextual words). These elements highlight the need to identify algorithms that, under these limitations, would suffice to account for both behavioral and brain responses. Focusing on the issue of speech processing, we here hypothesize that self-supervised algorithms trained on the raw waveform constitute a promising candidate. Specifically, we compare a recent self-supervised architecture, Wav2Vec 2.0, to the brain activity of 412 English, French, and Mandarin individuals recorded with functional Magnetic Resonance Imaging (fMRI), while they listened to ~1h of audio books. Our results are four-fold. First, we show that this algorithm learns brain-like representations with as little as 600 hours of unlabelled speech -- a quantity comparable to what infants can be exposed to during language acquisition. Second, its functional hierarchy aligns with the cortical hierarchy of speech processing. Third, different training regimes reveal a functional specialization akin to the cortex: Wav2Vec 2.0 learns sound-generic, speech-specific and language-specific representations similar to those of the prefrontal and temporal cortices. Fourth, we confirm the similarity of this specialization with the behavior of 386 additional participants. These elements, resulting from the largest neuroimaging benchmark to date, show how self-supervised learning can account for a rich organization of speech processing in the brain, and thus delineate a path to identify the laws of language acquisition which shape the human brain.


title: An extension of the stochastic sewing lemma and applications to fractional stochastic calculus

abstract: We give an extension of L\^e's stochastic sewing lemma [Electron. J. Probab. 25: 1 - 55, 2020]. The stochastic sewing lemma proves convergence in $L_m$ of Riemann type sums $\sum _{[s,t] \in \pi } A_{s,t}$ for an adapted two-parameter stochastic process $A$, under certain conditions on the moments of $A_{s,t}$ and of conditional expectations of $A_{s,t}$ given $\mathcal {F}_s$. Our extension replaces the conditional expectation given $\mathcal F_s$ by that given $\mathcal F_v$ for $v < s$, and it allows to make use of asymptotic decorrelation properties between $A_{s,t}$ and $\mathcal {F}_v$ by including a singularity in $(s-v)$. We provide three applications for which L\^e's stochastic sewing lemma seems to be insufficient.The first is to prove the convergence of It\^o or Stratonovich approximations of stochastic integrals along fractional Brownian motions under low regularity assumptions. The second is to obtain new representations of local times of fractional Brownian motions via discretization. The third is to improve a regularity assumption on the diffusion coefficient of a stochastic differential equation driven by a fractional Brownian motion for pathwise uniqueness and strong existence.


title: Strain-engineered wrinkles on graphene using polymeric actuators

abstract: The electronic and optical properties of graphene can be precisely tuned by generating deterministic arrangements of strain features. In this paper, we report the formation of widespread and controlled buckling delamination of monolayer graphene deposited on hexagonal boron-nitride promoted by a significant squeezing of the graphene flake and induced by polymeric micro-actuators. The flexibility of this method offers a promising technique to create arbitrary buckling geometries and arrays of wrinkles which could also be subjected to iterative folding-unfolding cycles. Further development of this method could pave the way to tune the properties of several kinds of other two-dimensional materials, such as transition metal dichalcogenides, by tailoring their surface topography.


title: L-systems for Measuring Repetitiveness*

abstract: An L-system (for lossless compression) is a CPD0L-system extended with two parameters $d$ and $n$, which determines unambiguously a string $w = \tau(\varphi^d(s))[1:n]$, where $\varphi$ is the morphism of the system, $s$ is its axiom, and $\tau$ is its coding. The length of the shortest description of an L-system generating $w$ is known as $\ell$, and is arguably a relevant measure of repetitiveness that builds on the self-similarities that arise in the sequence. In this paper we deepen the study of the measure $\ell$ and its relation with $\delta$, a better established lower bound that builds on substring complexity. Our results show that $\ell$ and $\delta$ are largely orthogonal, in the sense that one can be much larger than the other depending on the case. This suggests that both sources of repetitiveness are mostly unrelated. We also show that the recently introduced NU-systems, which combine the capabilities of L-systems with bidirectional macro-schemes, can be asymptotically strictly smaller than both mechanisms, which makes the size $\nu$ of the smallest NU-system the unique smallest reachable repetitiveness measure to date.


title: Symmetries in TEM imaging of crystals with strain

abstract: TEM images of strained crystals often exhibit symmetries, the source of which is not always clear. To understand these symmetries we distinguish between symmetries that occur from the imaging process itself and symmetries of the inclusion that might affect the image. For the imaging process we prove mathematically that the intensities are invariant under specific transformations. A combination of these invariances with specific properties of the strain profile can then explain symmetries observed in TEM images. We demonstrate our approach to the study of symmetries in TEM images using selected examples in the field of semiconductor nanostructures such as quantum wells and quantum dots.


title: Dynamic Kernel Selection for Improved Generalization and Memory Efficiency in Meta-learning

abstract: Gradient based meta-learning methods are prone to overfit on the meta-training set, and this behaviour is more prominent with large and complex networks. Moreover, large networks restrict the application of meta-learning models on low-power edge devices. While choosing smaller networks avoid these issues to a certain extent, it affects the overall generalization leading to reduced performance. Clearly, there is an approximately optimal choice of network architecture that is best suited for every meta-learning problem, however, identifying it beforehand is not straightforward. In this paper, we present MetaDOCK, a task-specific dynamic kernel selection strategy for designing compressed CNN models that generalize well on unseen tasks in meta-learning. Our method is based on the hypothesis that for a given set of similar tasks, not all kernels of the network are needed by each individual task. Rather, each task uses only a fraction of the kernels, and the selection of the kernels per task can be learnt dynamically as a part of the inner update steps. MetaDOCK compresses the meta-model as well as the task-specific inner models, thus providing significant reduction in model size for each task, and through constraining the number of active kernels for every task, it implicitly mitigates the issue of meta-overfitting. We show that for the same inference budget, pruned versions of large CNN models obtained using our approach consistently outperform the conventional choices of CNN models. MetaDOCK couples well with popular meta-learning approaches such as iMAML. The efficacy of our method is validated on CIFAR-fs and mini-ImageNet datasets, and we have observed that our approach can provide improvements in model accuracy of up to 2% on standard meta-learning benchmark, while reducing the model size by more than 75%.


title: Measuring Gender Bias in Word Embeddings of Gendered Languages Requires Disentangling Grammatical Gender Signals

abstract: Does the grammatical gender of a language interfere when measuring the semantic gender information captured by its word embeddings? A number of anomalous gender bias measurements in the embeddings of gendered languages suggest this possibility. We demonstrate that word embeddings learn the association between a noun and its grammatical gender in grammatically gendered languages, which can skew social gender bias measurements. Consequently, word embedding post-processing methods are introduced to quantify, disentangle, and evaluate grammatical gender signals. The evaluation is performed on five gendered languages from the Germanic, Romance, and Slavic branches of the Indo-European language family. Our method reduces the strength of grammatical gender signals, which is measured in terms of effect size (Cohen's d), by a significant average of d = 1.3 for French, German, and Italian, and d = 0.56 for Polish and Spanish. Once grammatical gender is disentangled, the association between over 90% of 10,000 inanimate nouns and their assigned grammatical gender weakens, and cross-lingual bias results from the Word Embedding Association Test (WEAT) become more congruent with country-level implicit bias measurements. The results further suggest that disentangling grammatical gender signals from word embeddings may lead to improvement in semantic machine learning tasks.


title: LTL with Local and Remote Data Constraints

abstract: We consider an extension of linear-time temporal logic (LTL) with both local and remote data constraints interpreted over a concrete domain. This extension is a natural extension of constraint LTL and the Temporal Logic of Repeating Values, which have been studied before. We shall use previous results to prove that the satisfiability problem for this logic is decidable. Further, we shall see that trying to extend this logic by making it more expressive can lead to undecidability.


title: Three-dimensional microstructure generation using generative adversarial neural networks in the context of continuum micromechanics

abstract: Multiscale simulations are demanding in terms of computational resources. In the context of continuum micromechanics, the multiscale problem arises from the need of inferring macroscopic material parameters from the microscale. If the underlying microstructure is explicitly given by means of microCT-scans, convolutional neural networks can be used to learn the microstructure-property mapping, which is usually obtained from computational homogenization. The CNN approach provides a significant speedup, especially in the context of heterogeneous or functionally graded materials. Another application is uncertainty quantification, where many expansive evaluations are required. However, one bottleneck of this approach is the large number of training microstructures needed. This work closes this gap by proposing a generative adversarial network tailored towards three-dimensional microstructure generation. The lightweight algorithm is able to learn the underlying properties of the material from a single microCT-scan without the need of explicit descriptors. During prediction time, the network can produce unique three-dimensional microstructures with the same properties of the original data in a fraction of seconds and at consistently high quality.


title: Towards an Algebra of Computon Spaces

abstract: Compositionality is a key property for dealing with complexity, which has been studied from many points of view in diverse fields. Particularly, the composition of individual computations (or programs) has been widely studied almost since the inception of computer science. Unlike existing composition theories, this paper presents an algebraic model not for composing individual programs but for inductively composing spaces of sequential and/or parallel constructs. We particularly describe the semantics of the proposed model and present an abstract example to demonstrate its application.


title: Optimal Design of Electric Machine with Efficient Handling of Constraints and Surrogate Assistance

abstract: Electric machine design optimization is a computationally expensive multi-objective optimization problem. While the objectives require time-consuming finite element analysis, optimization constraints can often be based on mathematical expressions, such as geometric constraints. This article investigates this optimization problem of mixed computationally expensive nature by proposing an optimization method incorporated into a popularly-used evolutionary multi-objective optimization algorithm - NSGA-II. The proposed method exploits the inexpensiveness of geometric constraints to generate feasible designs by using a custom repair operator. The proposed method also addresses the time-consuming objective functions by incorporating surrogate models for predicting machine performance. The article successfully establishes the superiority of the proposed method over the conventional optimization approach. This study clearly demonstrates how a complex engineering design can be optimized for multiple objectives and constraints requiring heterogeneous evaluation times and optimal solutions can be analyzed to select a single preferred solution and importantly harnessed to reveal vital design features common to optimal solutions as design principles.


title: Deep Learning Prediction of Severe Health Risks for Pediatric COVID-19 Patients with a Large Feature Set in 2021 BARDA Data Challenge

abstract: Most children infected with COVID-19 have no or mild symptoms and can recover automatically by themselves, but some pediatric COVID-19 patients need to be hospitalized or even to receive intensive medical care (e.g., invasive mechanical ventilation or cardiovascular support) to recover from the illnesses. Therefore, it is critical to predict the severe health risk that COVID-19 infection poses to children to provide precise and timely medical care for vulnerable pediatric COVID-19 patients. However, predicting the severe health risk for COVID-19 patients including children remains a significant challenge because many underlying medical factors affecting the risk are still largely unknown. In this work, instead of searching for a small number of most useful features to make prediction, we design a novel large-scale bag-of-words like method to represent various medical conditions and measurements of COVID-19 patients. After some simple feature filtering based on logistical regression, the large set of features is used with a deep learning method to predict both the hospitalization risk for COVID-19 infected children and the severe complication risk for the hospitalized pediatric COVID-19 patients. The method was trained and tested the datasets of the Biomedical Advanced Research and Development Authority (BARDA) Pediatric COVID-19 Data Challenge held from Sept. 15 to Dec. 17, 2021. The results show that the approach can rather accurately predict the risk of hospitalization and severe complication for pediatric COVID-19 patients and deep learning is more accurate than other machine learning methods.


title: Koebe's theorem for trinomials with fold symmetry

abstract: The Koebe problem for univalent polynomials with real coefficients is fully solved only for trinomials, which means that in this case the Koebe radius and the extremal polynomial (extremizer) have been found. The general case remains open, but conjectures have been formulated. The corresponding conjectures have also been hypothesized for univalent polynomials with real coefficients and $T$-fold rotational symmetry. This paper provides confirmation of these hypotheses for trinomials $z + az^{T + 1} + bz^{2T + 1}$. Namely, the Koebe radius is $r=4\cos^2 \frac{\pi(1+T)}{2+3T}$, and the only extremizer of the Koebe problem is the trinomial \begin{gather*} B^{(T)}(z)=z+\frac2{2+3T}\left(-T+(2+2T)\cos\frac{\pi T}{2+3T}\right)z^{1+T}+\\ +\frac1{2+3T}\left(2+T-2T\cos\frac{\pi T}{2+3T}\right)z^{1+2T}. \end{gather*} Key words and phrases: Koebe one-quarter theorem, Koebe radius, univalent polynomial, trinomials with fold symmetry.


title: Riemann surfaces for integer counting processes

abstract: Integer counting processes increment of an integer value at transitions between states of an underlying Markov process. The generator of a counting process, which depends on a parameter conjugate to the increments, defines a complex algebraic curve through its characteristic equation, and thus a compact Riemann surface. We show that the probability of a counting process can then be written as a contour integral on that Riemann surface. Several examples are discussed in details.

categories: cond-mat.stat-mech math-ph math.MP math.PR


title: Permutations with arithmetic constraints

abstract: Let $S_{\rm lcm}(n)$ denote the set of permutations $\pi$ of $[n]=\{1,2,\dots,n\}$ such that ${\rm lcm}[j,\pi(j)]\le n$ for each $j\in[n]$. Further, let $S_{\rm div}(n)$ denote the number of permutations $\pi$ of $[n]$ such that $j\mid\pi(j)$ or $\pi(j)\mid j$ for each $j\in[n]$. Clearly $S_{\rm div}(n)\subset S_{\rm lcm}(n)$. We get upper and lower bounds for the counts of these sets, showing they grow geometrically. We also prove a conjecture from a recent paper on the number of "anti-coprime" permutations of $[n]$, meaning that each $\gcd(j,\pi(j))>1$ except when $j=1$.


title: Composite Adaptive Control for Time-varying Systems with Dual Adaptation

abstract: This paper proposes a composite adaptive control architecture using dual adaptation scheme for dynamical systems comprising time-varying uncertain parameters. While majority of the adaptive control schemes in literature address the case of constant parameters, recent research has conceptualized improved adaptive control techniques for time-varying systems with rigorous stability proofs. The proposed work is an effort towards a similar direction, where a novel dual adaptation mechanism is introduced to efficiently tackle the time-varying nature of the parameters. Projection and $\sigma$-modification algorithms are strategically combined using congelation of variables to claim a global result for the tracking error space. While the classical adaptive systems demand a restrictive condition of persistence of excitation (PE) for accurate parameter estimation, the proposed work relies on a milder condition, called initial excitation (IE) for the same. A rigorous Lyapunov stability analysis is carried out to establish uniformly ultimately bounded (UUB) stability of the closed-loop system. Further it is analytically shown that the proposed work can recover the performance of previously designed IE-based adaptive controller in case of time invariant systems.


title: Many-body electronic structure of $d^{9-\delta}$ layered nickelates

abstract: The recent observation of superconductivity in an infinite-layer and quintuple-layer nickelate within the same $R_{n+1}$Ni$_{n}$O$_{2n+2}$ series ($R$ = rare-earth, $n=2-\infty$, with $n$ indicating the number of NiO$_{2}$ layers along the $c$-axis), unlocks their potential to embody a whole family of unconventional superconductors. Here, we systematically investigate the many-body electronic structure of the layered nickelates (with $n=2-6,\infty$) within a density-functional theory plus dynamical mean-field theory framework and contrast it with that of the known superconducting members of the series and with the cuprates. We find that many features of the electronic structure are common to the entire nickelate series, namely, strongly correlated Ni-$d_{x^{2}-y^{2}}$ orbitals that dominate the low-energy physics, mixed Mott-Hubbard/charge-transfer characteristics, and $R$($5d$) orbitals acting as charge reservoirs. Interestingly, we uncover that the electronic structure of the layered nickelates is highly tunable as the dimensionality changes from quasi-two-dimensional to three-dimensional as $n \rightarrow \infty$. Specifically, we identify the tunable electronic features to be: the charge-transfer energy, presence of $R(5d)$ states around the Fermi level, and the strength of electronic correlations.


title: Scalar is Not Enough: Vectorization-based Unbiased Learning to Rank

abstract: Unbiased learning to rank (ULTR) aims to train an unbiased ranking model from biased user click logs. Most of the current ULTR methods are based on the examination hypothesis (EH), which assumes that the click probability can be factorized into two scalar functions, one related to ranking features and the other related to bias factors. Unfortunately, the interactions among features, bias factors and clicks are complicated in practice, and usually cannot be factorized in this independent way. Fitting click data with EH could lead to model misspecification and bring the approximation error. In this paper, we propose a vector-based EH and formulate the click probability as a dot product of two vector functions. This solution is complete due to its universality in fitting arbitrary click functions. Based on it, we propose a novel model named Vectorization to adaptively learn the relevance embeddings and sort documents by projecting embeddings onto a base vector. Extensive experiments show that our method significantly outperforms the state-of-the-art ULTR methods on complex real clicks as well as simple simulated clicks.


title: Interactive Exploration of Large Dendrograms with Prototypes

abstract: Hierarchical clustering is one of the standard methods taught for identifying and exploring the underlying structures that may be present within a data set. Students are shown examples in which the dendrogram, a visual representation of the hierarchical clustering, reveals a clear clustering structure. However, in practice, data analysts today frequently encounter data sets whose large scale undermines the usefulness of the dendrogram as a visualization tool. Densely packed branches obscure structure, and overlapping labels are impossible to read. In this paper we present a new workflow for performing hierarchical clustering via the R package called protoshiny that aims to restore hierarchical clustering to its former role of being an effective and versatile visualization tool. Our proposal leverages interactivity combined with the ability to label internal nodes in a dendrogram with a representative data point (called a prototype). After presenting the workflow, we provide three case studies to demonstrate its utility.


title: KCRL: Krasovskii-Constrained Reinforcement Learning with Guaranteed Stability in Nonlinear Dynamical Systems

abstract: Learning a dynamical system requires stabilizing the unknown dynamics to avoid state blow-ups. However, current reinforcement learning (RL) methods lack stabilization guarantees, which limits their applicability for the control of safety-critical systems. We propose a model-based RL framework with formal stability guarantees, Krasovskii Constrained RL (KCRL), that adopts Krasovskii's family of Lyapunov functions as a stability constraint. The proposed method learns the system dynamics up to a confidence interval using feature representation, e.g. Random Fourier Features. It then solves a constrained policy optimization problem with a stability constraint based on Krasovskii's method using a primal-dual approach to recover a stabilizing policy. We show that KCRL is guaranteed to learn a stabilizing policy in a finite number of interactions with the underlying unknown system. We also derive the sample complexity upper bound for stabilization of unknown nonlinear dynamical systems via the KCRL framework.


title: Gradient Obfuscation Checklist Test Gives a False Sense of Security

abstract: One popular group of defense techniques against adversarial attacks is based on injecting stochastic noise into the network. The main source of robustness of such stochastic defenses however is often due to the obfuscation of the gradients, offering a false sense of security. Since most of the popular adversarial attacks are optimization-based, obfuscated gradients reduce their attacking ability, while the model is still susceptible to stronger or specifically tailored adversarial attacks. Recently, five characteristics have been identified, which are commonly observed when the improvement in robustness is mainly caused by gradient obfuscation. It has since become a trend to use these five characteristics as a sufficient test, to determine whether or not gradient obfuscation is the main source of robustness. However, these characteristics do not perfectly characterize all existing cases of gradient obfuscation, and therefore can not serve as a basis for a conclusive test. In this work, we present a counterexample, showing this test is not sufficient for concluding that gradient obfuscation is not the main cause of improvements in robustness.


title: Weighted Model Counting with Twin-Width

abstract: Bonnet et al. (FOCS 2020) introduced the graph invariant twin-width and showed that many NP-hard problems are tractable for graphs of bounded twin-width, generalizing similar results for other width measures, including treewidth and clique-width. In this paper, we investigate the use of twin-width for solving the propositional satisfiability problem (SAT) and propositional model counting. We particularly focus on Bounded-ones Weighted Model Counting (BWMC), which takes as input a CNF formula $F$ along with a bound $k$ and asks for the weighted sum of all models with at most $k$ positive literals. BWMC generalizes not only SAT but also (weighted) model counting. We develop the notion of "signed" twin-width of CNF formulas and establish that BWMC is fixed-parameter tractable when parameterized by the certified signed twin-width of $F$ plus $k$. We show that this result is tight: it is neither possible to drop the bound $k$ nor use the vanilla twin-width instead if one wishes to retain fixed-parameter tractability, even for the easier problem SAT. Our theoretical results are complemented with an empirical evaluation and comparison of signed twin-width on various classes of CNF formulas.


abstract: Approximate confidence distribution computing (ACDC) offers a new take on the rapidly developing field of likelihood-free inference from within a frequentist framework. The appeal of this computational method for statistical inference hinges upon the concept of a confidence distribution, a special type of estimator which is defined with respect to the repeated sampling principle. An ACDC method provides frequentist validation for computational inference in problems with unknown or intractable likelihoods. The main theoretical contribution of this work is the identification of a matching condition necessary for frequentist validity of inference from this method. In addition to providing an example of how a modern understanding of confidence distribution theory can be used to connect Bayesian and frequentist inferential paradigms, we present a case to expand the current scope of so-called approximate Bayesian inference to include non-Bayesian inference by targeting a confidence distribution rather than a posterior. The main practical contribution of this work is the development of a data-driven approach to drive ACDC in both Bayesian or frequentist contexts. The ACDC algorithm is data-driven by the selection of a data-dependent proposal function, the structure of which is quite general and adaptable to many settings. We explore two numerical examples that both verify the theoretical arguments in the development of ACDC and suggest instances in which ACDC outperform approximate Bayesian computing methods computationally.


title: Critical magnetic fluctuations in the layered ruthenates Ca$_2$RuO$_4$ and Ca$_3$Ru$_2$O$_7$

abstract: Materials realizing the XY model in two dimensions (2D) are sparse. Here we use neutron triple-axis spectroscopy to investigate the critical static and dynamical magnetic fluctuations in the square-lattice antiferromagnets Ca$_{2}$RuO$_{4}$ and Ca$_{3}$Ru$_2$O$_{7}$. We probe the temperature-dependence of the antiferromagnetic (AFM) Bragg-intensity, the $Q$-width, the amplitude, and the energy-width of the magnetic diffuse scattering in vicinity to the N\'eel temperature $T_N$ to determine the critical behavior of the magnetic order parameter $M$, correlation length $\xi$, susceptibility $\chi$, and the characteristic energy $\Gamma$ with the corresponding critical exponents $\beta$, $\nu$, $\gamma$, and $z$, respectively. We find that the critical behaviors of the single-layer compound Ca$_{2}$RuO$_{4}$ follow universal scaling laws that are compatible with predictions of the 2D-XY model. The bilayer compound Ca$_{3}$Ru$_2$O$_{7}$ is only partly consistent with the 2D-XY theory and best described by the three-dimensional Ising (3D-I) model, which is likely a consequence of the intra-bilayer exchange interactions in combination with an orthorhombic single-ion anisotropy. Hence, our results suggest that layered ruthenates are promising solid-state platforms for research on the 2D-XY model and the effects of 3D interactions and additional spin-space anisotropies on the magnetic fluctuations.


title: Cosmological Information in the Marked Power Spectrum of the Galaxy Field

abstract: Marked power spectra are two-point statistics of a marked field obtained by weighting each location with a function that depends on the local density around that point. We consider marked power spectra of the galaxy field in redshift space that up-weight low density regions, and perform a Fisher matrix analysis to assess the information content of this type of statistics using the Molino mock catalogs built upon the Quijote simulations. We identify four different ways to up-weight the galaxy field, and compare the Fisher information contained in their marked power spectra to the one of the standard galaxy power spectrum, when considering monopole and quadrupole of each statistic. Our results show that each of the four marked power spectra can tighten the standard power spectrum constraints on the cosmological parameters $\Omega_{\rm m}$, $\Omega_{\rm b}$, $h$, $n_s$, $M_\nu$ by $15-25\%$ and on $\sigma_8$ by a factor of 2. The same analysis performed by combining the standard and four marked power spectra shows a substantial improvement compared to the power spectrum constraints that is equal to a factor of 6 for $\sigma_8$ and $2.5-3$ for the other parameters. Our constraints may be conservative, since the galaxy number density in the Molino catalogs is much lower than the ones in future galaxy surveys, which will allow them to probe lower density regions of the large-scale structure.


title: Existence and Computation of Epistemic EFX Allocations

abstract: We consider the problem of allocating indivisible goods among $n$ agents in a fair manner. For this problem, one of the best notions of fairness is envy-freeness up to any good (EFX). However, it is not known if EFX allocations always exist. Hence, several relaxations of EFX allocations have been studied. We propose another relaxation of EFX, called epistemic EFX (EEFX). An allocation is EEFX iff for every agent $i$, it is possible to shuffle the goods of the other agents such that agent $i$ does not envy any other agent up to any good. We show that EEFX allocations always exist for additive valuations, and give a polynomial-time algorithm for computing them. We also show how EEFX is related to some previously-known notions of fairness.


title: Entropy and entanglement in a bipartite quasi-Hermitian system and its Hermitian counterparts

abstract: We consider a quantum oscillator coupled to a bath of $N$ other oscillators. The total system evolves with a quasi-Hermitian Hamiltonian. Associated to it is a family of Hermitian systems, parameterized by a unitary map $W$. Our main goal is to find the influence of $W$ on the entropy and the entanglement in the Hermitian systems. We calculate explicitly the reduced density matrix of the single oscillator for all Hermitian systems and show that, regardless of $W$, their von Neumann entropy oscillates with a common period which is twice that of the non-Hermitian system. We show that generically, the oscillator and the bath are entangled for almost all times. While the amount of entanglement depends on the choice of $W$, it is independent of $W$ when averaged over a period. These results describe some universality in the physical properties of all Hermitian systems associated to a given non-Hermitian one.


title: Learning about AGB stars by studying the stars polluted by their outflows

abstract: A rich zoo of peculiar objects forms when Asymptotic Giant Branch (AGB) stars, undergo interactions in a binary system. For example, Barium (Ba) stars are main-sequence and red-giant stars that accreted mass from the outflows of a former AGB companion, which is now a dim white dwarf (WD). Their orbital properties can help us constrain AGB binary interaction mechanisms, and their chemical abundances are a tracer of the nucleosynthesis processes that took place inside the former AGB star. The observational constraints concerning the orbital and stellar properties of Ba stars have increased in the past years, but important uncertainties remained concerning their WD companions. In this contribution, we used HD76225 to demonstrate that by combining radial-velocity data with Hipparcos and Gaia astrometry, one can accurately constrain the orbital inclinations of these systems and obtain the absolute masses of these WDs, getting direct information about their AGB progenitors via initial-final mass relationships.


title: Relative forms of real algebraic varieties and examples of quasi-projective surfaces with algebraic moduli of real forms

abstract: We propose a framework to give a precise meaning to the intuitive notion of "family of real forms of a variety parametrised by a variety" and study some fundamental properties of this notion. As an illustration, for any $n \geq 1$, we construct the first example of a quasi-projective real surface whose mutually non-isomorphic real forms admit a moduli of dimension at least $n$, parametrised by the real points of an affine $n$-space. Expanding on these constructions, we can give quasi-projective real varieties of any dimension whose algebraic moduli of the non-isomorphic real forms has arbitrarily positive dimension.


title: Compositional Visual Generation with Composable Diffusion Models

abstract: Large text-guided diffusion models, such as DALLE-2, are able to generate stunning photorealistic images given natural language descriptions. While such models are highly flexible, they struggle to understand the composition of certain concepts, such as confusing the attributes of different objects or relations between objects. In this paper, we propose an alternative structured approach for compositional generation using diffusion models. An image is generated by composing a set of diffusion models, with each of them modeling a certain component of the image. To do this, we interpret diffusion models as energy-based models in which the data distributions defined by the energy functions may be explicitly combined. The proposed method can generate scenes at test time that are substantially more complex than those seen in training, composing sentence descriptions, object relations, human facial attributes, and even generalizing to new combinations that are rarely seen in the real world. We further illustrate how our approach may be used to compose pre-trained text-guided diffusion models and generate photorealistic images containing all the details described in the input descriptions, including the binding of certain object attributes that have been shown difficult for DALLE-2. These results point to the effectiveness of the proposed method in promoting structured generalization for visual generation. Project page: https://energy-based-model.github.io/Compositional-Visual-Generation-with-Composable-Diffusion-Models/


title: Towards Evading the Limits of Randomized Smoothing: A Theoretical Analysis

abstract: Randomized smoothing is the dominant standard for provable defenses against adversarial examples. Nevertheless, this method has recently been proven to suffer from important information theoretic limitations. In this paper, we argue that these limitations are not intrinsic, but merely a byproduct of current certification methods. We first show that these certificates use too little information about the classifier, and are in particular blind to the local curvature of the decision boundary. This leads to severely sub-optimal robustness guarantees as the dimension of the problem increases. We then show that it is theoretically possible to bypass this issue by collecting more information about the classifier. More precisely, we show that it is possible to approximate the optimal certificate with arbitrary precision, by probing the decision boundary with several noise distributions. Since this process is executed at certification time rather than at test time, it entails no loss in natural accuracy while enhancing the quality of the certificates. This result fosters further research on classifier-specific certification and demonstrates that randomized smoothing is still worth investigating. Although classifier-specific certification may induce more computational cost, we also provide some theoretical insight on how to mitigate it.


title: Quantum covariant derivative

abstract: The covariant derivative capable of differentiating and parallel transporting tangent vectors and other geometric objects induced by a parameter-dependent quantum state is introduced. It is proved to be covariant under gauge and coordinate transformations and compatible with the quantum geometric tensor. The quantum covariant derivative is used to derive a gauge- and coordinate-invariant adiabatic perturbation theory, providing an efficient tool for calculations of nonlinear adiabatic response properties.


title: A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features

abstract: An important characteristic of neural networks is their ability to learn representations of the input data with effective features for prediction, which is believed to be a key factor to their superior empirical performance. To better understand the source and benefit of feature learning in neural networks, we consider learning problems motivated by practical data, where the labels are determined by a set of class relevant patterns and the inputs are generated from these along with some background patterns. We prove that neural networks trained by gradient descent can succeed on these problems. The success relies on the emergence and improvement of effective features, which are learned among exponentially many candidates efficiently by exploiting the data (in particular, the structure of the input distribution). In contrast, no linear models on data-independent features of polynomial sizes can learn to as good errors. Furthermore, if the specific input structure is removed, then no polynomial algorithm in the Statistical Query model can learn even weakly. These results provide theoretical evidence showing that feature learning in neural networks depends strongly on the input structure and leads to the superior performance. Our preliminary experimental results on synthetic and real data also provide positive support.


title: A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge

abstract: The Visual Question Answering (VQA) task aspires to provide a meaningful testbed for the development of AI models that can jointly reason over visual and natural language inputs. Despite a proliferation of VQA datasets, this goal is hindered by a set of common limitations. These include a reliance on relatively simplistic questions that are repetitive in both concepts and linguistic structure, little world knowledge needed outside of the paired image, and limited reasoning required to arrive at the correct answer. We introduce A-OKVQA, a crowdsourced dataset composed of a diverse set of about 25K questions requiring a broad base of commonsense and world knowledge to answer. In contrast to the existing knowledge-based VQA datasets, the questions generally cannot be answered by simply querying a knowledge base, and instead require some form of commonsense reasoning about the scene depicted in the image. We demonstrate the potential of this new dataset through a detailed analysis of its contents and baseline performance measurements over a variety of state-of-the-art vision-language models. Project page: http://a-okvqa.allenai.org/


title: Tilting light's polarization plane to spatially separate the nonlinear optical response of chiral molecules on ultrafast timescales

abstract: Distinguishing between the left- and right-handed versions of a chiral molecule (enantiomers) is vital, but also inherently difficult. Traditional optical methods using elliptically or circularly polarized light rely on weak linear effects which arise beyond the electric-dipole approximation, posing major limitations for time resolving ultrafast chiral molecular dynamics. Here we show how, by tilting the plane of polarization of an ultrashort burst of intense elliptically polarized light, towards its propagation direction, we can turn the light field into a highly efficient chiro-optical tool. This "forward tilting" can be achieved by focusing the beam tightly, creating structured light which exhibits a nontrivial polarization pattern in space. We demonstrate that our structured field allows us to realize an interferometer for efficient chiral recognition that separates the nonlinear optical response of left- and right-handed molecules in space. Our work provides a simple, yet highly efficient, way of spatially structuring the polarization of light to image molecular chirality, with extreme enantio-sensitivity and on ultrafast time scales.


title: Revisiting the "Video" in Video-Language Understanding

abstract: What makes a video task uniquely suited for videos, beyond what can be understood from a single image? Building on recent progress in self-supervised image-language models, we revisit this question in the context of video and language tasks. We propose the atemporal probe (ATP), a new model for video-language analysis which provides a stronger bound on the baseline accuracy of multimodal models constrained by image-level understanding. By applying this model to standard discriminative video and language tasks, such as video question answering and text-to-video retrieval, we characterize the limitations and potential of current video-language benchmarks. We find that understanding of event temporality is often not necessary to achieve strong or state-of-the-art performance, even compared with recent large-scale video-language models and in contexts intended to benchmark deeper video-level understanding. We also demonstrate how ATP can improve both video-language dataset and model design. We describe a technique for leveraging ATP to better disentangle dataset subsets with a higher concentration of temporally challenging data, improving benchmarking efficacy for causal and temporal understanding. Further, we show that effectively integrating ATP into full video-level temporal models can improve efficiency and state-of-the-art accuracy.


title: Orientation of convex sets

abstract: We introduce a novel definition of orientation on the triples of a family of pairwise intersecting planar convex sets and study its properties. In particular, we compare it to other systems of orientations on triples that satisfy a so-called interiority condition: $\circlearrowleft(ABD)=~\circlearrowleft(BCD)=~\circlearrowleft(CAD)=1$ imply $\circlearrowleft(ABC)=1$ for any $A,B,C,D$. We call such an orientation a P3O (partial 3-order), a natural generalization of a poset, that has several interesting special cases. For example, the order type of a planar point set (that can have collinear triples) is a P3O; we denote a P3O realizable by points as p-P3O. If we do not allow $\circlearrowleft(ABC)=0$, we obtain a T3O (total 3-order). Contrary to linear orders, a T3O can have a rich structure. A T3O realizable by points, a p-T3O, is the order type of a point set in general position. Despite these similarities to order types, P3O and p-T3O that can arise from the orientation of pairwise intersecting convex sets, denoted by C-P3O and C-T3O, turn out to be quite different from order types: there is no containment relation among the family of all C-P3O's and the family of all p-P3O's, or among the families of C-T3O's and p-T3O's. Finally, we study properties of these orientations if we also require that the family of underlying convex sets satisfies the (4,3) property.


title: A Learning-Based Method for Automatic Operator Selection in the Fanoos XAI System

abstract: We describe an extension of the Fanoos XAI system [Bayani et al 2022] which enables the system to learn the appropriate action to take in order to satisfy a user's request for description to be made more or less abstract. Specifically, descriptions of systems under analysis are stored in states, and in order to make a description more or less abstract, Fanoos selects an operator from a large library to apply to the state and generate a new description. Prior work on Fanoos predominately used hand-written methods for operator-selection; this current work allows Fanoos to leverage experience to learn the best operator to apply in a particular situation, balancing exploration and exploitation, leveraging expert insights when available, and utilizing similarity between the current state and past states. Additionally, in order to bootstrap the learning process (i.e., like in curriculum learning), we describe a simulated user which we implemented; this simulation allows Fanoos to gain general insights that enable reasonable courses of action, insights which later can be refined by experience with real users, as opposed to interacting with humans completely from scratch. Code implementing the methods described in the paper can be found at https://github/DBay-ani/Operator_Selection_Learning_Extensions_For_Fanoos.


title: Orientation of good covers

abstract: We study systems of orientations on triples that satisfy the following so-called interiority condition: $\circlearrowleft(ABD)=~\circlearrowleft(BCD)=~\circlearrowleft(CAD)=1$ implies $\circlearrowleft(ABC)=1$ for any $A,B,C,D$. We call such an orientation a P3O (partial 3-order), a natural generalization of a poset, that has several interesting special cases. For example, the order type of a planar point set (that can have collinear triples) is a P3O; we denote a P3O realizable by points as p-P3O. If we do not allow $\circlearrowleft(ABC)=0$, we obtain a T3O (total 3-order). Contrary to linear orders, a T3O can have a rich structure. A T3O realizable by points, a p-T3O, is the order type of a point set in general position. In our paper "Orientation of convex sets" we defined a 3-order on pairwise intersecting convex sets; such a P3O is called a C-P3O. In this paper we extend this 3-order to pairwise intersecting good covers; such a P3O is called a GC-P3O. If we do not allow $\circlearrowleft(ABC)=0$, we obtain a C-T3O and a GC-T3O, respectively. The main result of this paper is that there is a p-T3O that is not a GC-T3O, implying also that it is not a C-T3O -- this latter problem was left open in our earlier paper. Our proof involves several combinatorial and geometric observations that can be of independent interest. Along the way, we define several further special families of GC-T3O's.


title: SNAKE: Shape-aware Neural 3D Keypoint Field

abstract: Detecting 3D keypoints from point clouds is important for shape reconstruction, while this work investigates the dual question: can shape reconstruction benefit 3D keypoint detection? Existing methods either seek salient features according to statistics of different orders or learn to predict keypoints that are invariant to transformation. Nevertheless, the idea of incorporating shape reconstruction into 3D keypoint detection is under-explored. We argue that this is restricted by former problem formulations. To this end, a novel unsupervised paradigm named SNAKE is proposed, which is short for shape-aware neural 3D keypoint field. Similar to recent coordinate-based radiance or distance field, our network takes 3D coordinates as inputs and predicts implicit shape indicators and keypoint saliency simultaneously, thus naturally entangling 3D keypoint detection and shape reconstruction. We achieve superior performance on various public benchmarks, including standalone object datasets ModelNet40, KeypointNet, SMPL meshes and scene-level datasets 3DMatch and Redwood. Intrinsic shape awareness brings several advantages as follows. (1) SNAKE generates 3D keypoints consistent with human semantic annotation, even without such supervision. (2) SNAKE outperforms counterparts in terms of repeatability, especially when the input point clouds are down-sampled. (3) the generated keypoints allow accurate geometric registration, notably in a zero-shot setting. Codes are available at https://github.com/zhongcl-thu/SNAKE


title: Sentences as connection paths: A neural language architecture of sentence structure in the brain

abstract: This article presents a neural language architecture of sentence structure in the brain, in which sentences are temporal connection paths that interconnect neural structures underlying their words. Words remain 'in-situ', hence they are always content-addressable. Arbitrary and novel sentences (with novel words) can be created with 'neural blackboards' for words and sentences. Hence, the unlimited productivity of natural language can be achieved with a 'fixed' small world like network structure. The article focuses on the neural blackboard for sentences. The architecture uses only one 'connection matrix' for binding all structural relations between words in sentences. Its ability to represent arbitrary (English) sentences is discussed in detail, based on a comprehensive analysis of them. The architecture simulates intra-cranial brain activity observed during sentence processing and fMRI observations related to sentence complexity and ambiguity. The simulations indicate that the observed effects relate to global control over the architecture, not to the sentence structures involved, which predicts higher activity differences related to complexity and ambiguity with higher comprehension capacity. Other aspects discussed are the 'intrinsic' sentence structures provided by connection paths and their relation to scope and inflection, the use of a dependency parser for control of binding, long-distance dependencies and gaps, question answering, ambiguity resolution based on backward processing without explicit backtracking, garden paths, and performance difficulties related to embeddings.