title: Uniformization of some weight 3 variations of Hodge structure, Anosov representations, and Lyapunov exponents

abstract: We develop a class of uniformizations for certain weight 3 variations of Hodge structure (VHS). The analytic properties of the VHS are used to establish a conjecture of Eskin, Kontsevich, M\"oller, and Zorich on Lyapunov exponents. Additionally, we prove that the monodromy representations are log-Anosov, a dynamical property that has a number of global consequences for the VHS. We establish a strong Torelli theorem for the VHS and describe appropriate domains of discontinuity. Additionally, we classify the hypergeometric differential equations that satisfy our assumptions. We obtain several multi-parameter families of equations, which include the mirror quintic as well as the six other thin cases of Doran--Morgan and Brav--Thomas.


title: Understanding the Evolution of Blockchain Ecosystems: A Longitudinal Measurement Study of Bitcoin, Ethereum, and EOSIO

abstract: The continuing expansion of the blockchain ecosystems has attracted much attention from the research community. However, although a large number of research studies have been proposed to understand the diverse characteristics of individual blockchain systems (e.g., Bitcoin or Ethereum), little is known at a comprehensive level on the evolution of blockchain ecosystems at scale, longitudinally, and across multiple blockchains. We argue that understanding the dynamics of blockchain ecosystems could provide unique insights that cannot be achieved through studying a single static snapshot or a single blockchain network alone. Based on billions of transaction records collected from three representative and popular blockchain systems (Bitcoin, Ethereum and EOSIO) over 10 years, we conduct the first study on the evolution of multiple blockchain ecosystems from different perspectives. Our exploration suggests that, although the overall blockchain ecosystem shows promising growth over the last decade, a number of worrying outliers exist that have disrupted its evolution.


title: A perturbative CFT dual for pure NS-NS AdS$_3$ strings

abstract: We construct a CFT dual to string theory on AdS$_3$ with pure NS-NS flux. It is given by a symmetric orbifold of a linear dilaton theory deformed by a marginal operator from the twist-2 sector. We compute two- and three-point functions on the CFT side to 4th order in conformal perturbation theory at large $N$. They agree with the string computation at genus 0, thus providing ample evidence for a duality. We also show that the full spectra of both short and long strings on the CFT and the string side match. The duality should be understood as perturbative in $N^{-1}$.


title: On-demand large-conductance in trivial zero-bias tunneling peaks in Majorana nanowires

abstract: Motivated by recent experiments that report the almost-generic large-conductance peaks without very extensive fine-tuning, we propose an alternative mechanism through direct theoretical simulations that can explain the large zero-bias conductance peaks being generated on-demand in the nontopological regime in Majorana nanowires by satisfying the following three sufficient conditions: (i) strong potential disorder in the bulk of the nanowire, suppressing the topological regime; (ii) strong suppression of the disorder near the nanowire ends connecting to the tunneling leads, perhaps because of screening by the metallic leads and gates; and (iii) low tunnel barrier strength leading to large tunneling amplitude. The third condition is typically achieved experimentally by fine-tuning the tunnel barrier and the first condition is generic in all existing nanowires by virtue of considerable sample disorder induced by unintentional random quenched charged impurities. The second condition is likely to apply to many samples since the disorder potential would be typically screened more strongly at the wire ends because of the large metallic tunnel pads used experimentally. We show that the resultant tunneling conductance manifests large trivial zero-bias peaks almost on demand, and such peaks could be $\sim 2e^2/h$, when appropriately fine-tuned by the tunnel barrier strength and the temperature, as reported experimentally. Our work not only solves the mystery in recent experiments that the observations of the large zero-bias conductance peaks are generic by proposing a theoretically possible mechanism but also explains why these hypothesized conditions are naturally satisfied in experiments.


title: Toward Degradation-Robust Voice Conversion

abstract: Any-to-any voice conversion technologies convert the vocal timbre of an utterance to any speaker even unseen during training. Although there have been several state-of-the-art any-to-any voice conversion models, they were all based on clean utterances to convert successfully. However, in real-world scenarios, it is difficult to collect clean utterances of a speaker, and they are usually degraded by noises or reverberations. It thus becomes highly desired to understand how these degradations affect voice conversion and build a degradation-robust model. We report in this paper the first comprehensive study on the degradation robustness of any-to-any voice conversion. We show that the performance of state-of-the-art models nowadays was severely hampered given degraded utterances. To this end, we then propose speech enhancement concatenation and denoising training to improve the robustness. In addition to common degradations, we also consider adversarial noises, which alter the model output significantly yet are human-imperceptible. It was shown that both concatenations with off-the-shelf speech enhancement models and denoising training on voice conversion models could improve the robustness, while each of them had pros and cons.


title: Higher-order Oscillatory Planar Hall Effect in Topological Kagome Metal

abstract: Exploration of exotic transport behavior for quantum materials is of great interest and importance for revealing exotic orders to bring new physics. In this Letter, we report the observation of exotic prominent planar Hall effect (PHE) and planar anisotropic magnetoresistivity (PAMR) in strange kagome metal KV$_3$Sb$_5$. The PHE and PAMR, which are driven by an in-plane magnetic field and display sharp difference from other Hall effects driven by an out-of-plane magnetic field or magnetization, exhibit exotic higher-order oscillations in sharp contrast to those following empirical rule only allowing twofold symmetrical oscillations. These higher-order oscillations exhibit strong field and temperature dependence and vanish around charge density wave (CDW) transition. The unique transport properties suggest a significant interplay of the lattice, magnetic and electronic structure in KV$_3$Sb$_5$. This interplay can couple the hidden anisotropy and transport electrons leading to the novel PHE and PAMR in contrast to other materials.


title: BOSS Correlation Function Analysis from the Effective Field Theory of Large-Scale Structure

abstract: After calibrating the predictions of the Effective Field Theory of Large-Scale Structure against several sets of simulations, as well as implementing a new method to assert the scale cut of the theory without the use of any simulation, we analyze the Full Shape of the BOSS Correlation Function. Imposing a prior from Big Bang Nucleosynthesis on the baryon density, we are able to measure all the parameters in $\Lambda$CDM + massive neutrinos in normal hierarchy, except for the total neutrino mass, which is just bounded. When combining the BOSS Full Shape with the Baryon Acoustic Oscillation measurements from BOSS, 6DF/MGS and eBOSS, we determine the present day Hubble constant, $H_0$, the present matter fraction, $\Omega_m$, the amplitude of the primordial power spectrum, $A_s$, and the tilt of the primordial power spectrum, $n_s$, to $1.4 \%, 4.5 \%, 23.5\%$ and $7.6\%$ precision, respectively, at $68 \%$-confidence level, finding $H_0=68.19 \pm 0.99$ (km/s)/Mpc, $\Omega_m=0.309\pm 0.014$, $\ln (10^{10}A_{s })=3.12^{+0.21}_{-0.26}$ and $n_s=0.963^{+0.062}_{-0.085}$, and we bound the total neutrino mass to $0.87 \, \textrm{eV}$ at $95 \%$-confidence level. These constraints are fully consistent with Planck results and the ones obtained from BOSS power spectrum analysis. In particular, we find no tension in $H_0$ or $\sigma_8$ with Planck measurements, finding consistency at $1.2\sigma$ and $0.6\sigma$, respectively.


title: Billiards in right triangles and orbit closures in genus zero strata

abstract: The orbit closure of the unfolding of every rational right and isosceles triangle is computed and the asymptotic number of periodic billiard trajectories in these triangles is deduced. This follows by classifying all orbit closures of rank at least two in hyperelliptic components of strata of Abelian and quadratic differentials. Additionally, given a fixed set of angles, the orbit closure of the unfolding of all unit area rational parallelograms, isosceles trapezoids, and right trapezoids outside of a discrete set is determined.


title: Leading-Color Two-Loop Amplitudes for Four Partons and a W Boson in QCD

abstract: We present the leading-color two-loop QCD corrections for the scattering of four partons and a $W$ boson, including its leptonic decay. The amplitudes are assembled from the planar two-loop helicity amplitudes for four partons and a vector boson decaying to a lepton pair, which are also used to determine the planar two-loop amplitudes for four partons and a $Z/\gamma^*$ boson with a leptonic decay. The analytic expressions are obtained by setting up a dedicated Ansatz and constraining the free parameters from numerical samples obtained within the framework of numerical unitarity. The large linear systems that must be solved to determine the analytic expressions are constructed to be in Vandermonde form. Such systems can be very efficiently solved, bypassing the bottleneck of Gaussian elimination. Our results are expressed in a basis of one-mass pentagon functions, which opens the possibility of their efficient numerical evaluation.


title: ALFRED: Virtual Memory for Intermittent Computing

abstract: We present ALFRED: a virtual memory abstraction that resolves the dichotomy between volatile and non-volatile memory in intermittent computing. Mixed-volatile microcontrollers allow programmers to allocate part of the application state onto non-volatile main memory. Programmers are therefore to explore manually the trade-off between simpler management of persistent state against the energy overhead for non-volatile memory operations and intermittence anomalies due to re-execution of non-idempotent code. This approach is laborious and yields sub-optimal performance. We take a different stand with ALFRED: we provide programmers with a virtual memory abstraction detached from the specific volatile nature of memory and automatically determine an efficient mapping from virtual to volatile or non-volatile memory. Unlike existing works, ALFRED does not require programmers to learn a new programming model or language syntax, while the mapping is entirely resolved at compile-time, reducing the run-time energy overhead. We implement ALFRED through a series of program machine-level code transformations. Compared to existing systems, we demonstrate that ALFRED reduces energy consumption by up to two orders of magnitude given a fixed workload. This enables the workloads to finish sooner, as the use of available energy shifts from ensuring forward progress to useful application processing.


title: Well-posedness of logarithmic spiral vortex sheets

abstract: We consider a family of 2D logarithmic spiral vortex sheets which include the celebrated spirals introduced by Prandtl (Vortr\"age aus dem Gebiete der Hydro- und Aero-dynamik, 1922) and by Alexander (Phys. Fluids, 1971). We prove that for each such spiral the normal component of the velocity field remains continuous across the spiral. We give sufficient conditions for spiral vortex sheets to be weak solutions of the 2D incompressible Euler equations. Namely, we show that a spiral gives rise to such a solution if and only if two conditions hold across every spiral: a velocity matching condition and a pressure matching condition. Furthermore we show that these two conditions are equivalent to the imaginary part and the real part, respectively, of a single complex constraint on the coefficients of the spirals. This in particular provides a rigorous mathematical framework for logarithmic spirals, an issue that has remained open since their introduction by Prandtl in 1922. Another consequence of the main result is well-posedness of the symmetric Alexander spiral with two branches, despite recent evidence for the contrary. Moreover, our result implies a sharpness result of Delort's theorem on global existence of solutions to the Euler equations with initial vorticity measure. Our main tools are new explicit formulas for the velocity field and for the pressure function, as well as a notion of a \emph{winding number} of a spiral, which not only gives a robust way of localizing the spirals' arms with respect to a given point in the plane, but also ensures correct asymptotic behaviour near $0$.


title: Acoustic helical dichroism in a one-dimensional lattice of chiral resonators

abstract: Circular dichroism and helical dichroism are intriguing chiroptical phenomena with broad applications in optical sensing and imaging. Here, we generalize one of the phenomena-helical dichroism-to acoustics. We show that a one-dimensional lattice of chiral resonators with loss can induce differential absorption of helical sounds (i.e. acoustic vortices) carrying opposite orbital angular momentum (OAM). This acoustic helical dichroism strongly depends on the rotation symmetry of the chiral resonators. A breaking of the $C_4$ rotation symmetry can induce coupling between the opposite chiral dipole modes of the resonators. This leads to OAM bandgaps and non-Hermitian exceptional points near the Brillouin-zone center and boundaries, which together give rise to significantly enhanced helical dichroism. The underlying physics can be well captured by an effective Hamiltonian that quantitatively reproduces the complex band structures. The acoustic helical dichroism can find important applications in acoustic OAM manipulations and chiral sound-matter interactions.


title: Automatic Generation of Grover Quantum Oracles for Arbitrary Data Structures

abstract: The steadily growing research interest in quantum computing - together with the accompanying technological advances in the realization of quantum hardware - fuels the development of meaningful real-world applications, as well as implementations for well-known quantum algorithms. One of the most prominent examples till today is Grover's algorithm, which can be used for efficient search in unstructured databases. Quantum oracles that are frequently masked as black boxes play an important role in Grover's algorithm. Hence, the automatic generation of oracles is of paramount importance. Moreover, the automatic generation of the corresponding circuits for a Grover quantum oracle is deeply linked to the synthesis of reversible quantum logic, which - despite numerous advances in the field - still remains a challenge till today in terms of synthesizing efficient and scalable circuits for complex boolean functions. In this paper, we present a flexible method for automatically encoding unstructured databases into oracles, which can then be efficiently searched with Grover's algorithm. Furthermore, we develop a tailor-made method for quantum logic synthesis, which vastly improves circuit complexity over other current approaches. Finally, we present another logic synthesis method that considers the requirements of scaling onto real world backends. We compare our method with other approaches through evaluating the oracle generation for random databases and analyzing the resulting circuit complexities using various metrics.


title: Active SLAM over Continuous Trajectory and Control: A Covariance-Feedback Approach

abstract: This paper proposes a novel active Simultaneous Localization and Mapping (SLAM) method with continuous trajectory optimization over a stochastic robot dynamics model. The problem is formalized as a stochastic optimal control over the continuous robot kinematic model to minimize a cost function that involves the covariance matrix of the landmark states. We tackle the problem by separately obtaining an open-loop control sequence subject to deterministic dynamics by iterative Covariance Regulation (iCR) and a closed-loop feedback control under stochastic robot and covariance dynamics by Linear Quadratic Regulator (LQR). The proposed optimization method captures the coupling between localization and mapping in predicting uncertainty evolution and synthesizes highly informative sensing trajectories. We demonstrate its performance in active landmark-based SLAM using relative-position measurements with a limited field of view.


title: Reconfigurable, Intelligent, and SustainableWireless Environments for 6G Smart Connectivity

abstract: Various visions on the forthcoming sixth Generation (6G) networks point towards flexible connect-and-compute technologies to support future innovative services and the corresponding use cases. 6G should be capable to accommodate ever-evolving and heterogeneous applications, future regulations, and diverse user-, service-, and location-based requirements. A key element towards building smart and energy sustainable wireless systems beyond 5G is the Reconfigurable Intelligent Surface (RIS), which offers programmable control and shaping of the wireless propagation environment. Capitalizing on this technology potential, in this article we introduce two new concepts: i) wireless environment as a service, which leverages a novel RIS-empowered networking paradigm to trade off diverse, and usually conflicting, connectivity objectives; and ii) performance-boosted areas enabled by RIS-based connectivity, representing competing service provisioning areas that are highly spatially and temporally focused. We discuss the key technological enablers and research challenges with the proposed networking paradigm, and highlight the potential profound role of RISs in the recent Open Radio Access Network (O-RAN) architecture.


title: Quantum theory without classical time: octonions, and a theoretical derivation of the fine structure constant 1/137

abstract: There must exist a reformulation of quantum field theory which does not refer to classical time. We propose a pre-quantum, pre-spacetime theory, which is a matrix-valued Lagrangian dynamics for gravity, Yang-Mills fields, and fermions. The definition of spin in this theory leads us to an eight dimensional octonionic space-time. The algebra of the octonions reveals the standard model; model parameters are determined by roots of the cubic characteristic equation of the exceptional Jordan algebra. We derive the asymptotic low energy value 1/137 of the fine structure constant, and predict the existence of universally interacting spin one Lorentz bosons, which replace the hypothesised graviton. Gravity is not to be quantized, but is an emergent four-dimensional classical phenomenon, precipitated by the spontaneous localisation of highly entangled fermions.


title: Time Series Clustering for Human Behavior Pattern Mining

abstract: Human behavior modeling deals with learning and understanding behavior patterns inherent in humans' daily routines. Existing pattern mining techniques either assume human dynamics is strictly periodic, or require the number of modes as input, or do not consider uncertainty in the sensor data. To handle these issues, in this paper, we propose a novel clustering approach for modeling human behavior (named, MTpattern) from time-series data. For mining frequent human behavior patterns effectively, we utilize a three-stage pipeline: (1) represent time series data into a sequence of regularly sampled equal-sized unit time intervals for better analysis, (2) a new distance measure scheme is proposed to cluster similar sequences which can handle temporal variation and uncertainty in the data, and (3) exploit an exemplar-based clustering mechanism and fine-tune its parameters to output minimum number of clusters with given permissible distance constraints and without knowing the number of modes present in the data. Then, the average of all sequences in a cluster is considered as a human behavior pattern. Empirical studies on two real-world datasets and a simulated dataset demonstrate the effectiveness of MTpattern with respect to internal and external measures of clustering.


title: The Irrationality of Neural Rationale Models

abstract: Neural rationale models are popular for interpretable predictions of NLP tasks. In these, a selector extracts segments of the input text, called rationales, and passes these segments to a classifier for prediction. Since the rationale is the only information accessible to the classifier, it is plausibly defined as the explanation. Is such a characterization unconditionally correct? In this paper, we argue to the contrary, with both philosophical perspectives and empirical evidence suggesting that rationale models are, perhaps, less rational and interpretable than expected. We call for more rigorous and comprehensive evaluations of these models to ensure desired properties of interpretability are indeed achieved. The code can be found at https://github.com/yimingz89/Neural-Rationale-Analysis.


title: On scalar curvature lower bounds and scalar curvature measure

abstract: We relate the (non)existence of lower scalar curvature bounds to the existence of certain distance-decreasing maps. We also give a sufficient condition for the existence of a limiting scalar curvature measure in the backward limit of a Ricci flow solution.


title: BI-RADS BERT & Using Section Segmentation to Understand Radiology Reports

abstract: Radiology reports are one of the main forms of communication between radiologists and other clinicians and contain important information for patient care. In order to use this information for research and automated patient care programs, it is necessary to convert the raw text into structured data suitable for analysis. State-of-the-art natural language processing (NLP) domain-specific contextual word embeddings have been shown to achieve impressive accuracy for these tasks in medicine, but have yet to be utilized for section structure segmentation. In this work, we pre-trained a contextual embedding BERT model using breast radiology reports and developed a classifier that incorporated the embedding with auxiliary global textual features in order to perform section segmentation. This model achieved a 98% accuracy at segregating free text reports sentence by sentence into sections of information outlined in the Breast Imaging Reporting and Data System (BI-RADS) lexicon, a significant improvement over the Classic BERT model without auxiliary information. We then evaluated whether using section segmentation improved the downstream extraction of clinically relevant information such as modality/procedure, previous cancer, menopausal status, the purpose of the exam, breast density, and breast MRI background parenchymal enhancement. Using the BERT model pre-trained on breast radiology reports combined with section segmentation resulted in an overall accuracy of 95.9% in the field extraction tasks. This is a 17% improvement compared to an overall accuracy of 78.9% for field extraction with models using Classic BERT embeddings and not using section segmentation. Our work shows the strength of using BERT in radiology report analysis and the advantages of section segmentation in identifying key features of patient factors recorded in breast radiology reports.


title: A Flat Wall Theorem for Matching Minors in Bipartite Graphs

abstract: A major step in the graph minors theory of Robertson and Seymour is the transition from the Grid Theorem which, in some sense uniquely, describes areas of large treewidth within a graph, to a notion of local flatness of these areas in form of the existence of a large flat wall within any huge grid of an H-minor free graph. In this paper, we prove a matching theoretic analogue of the Flat Wall Theorem for bipartite graphs excluding a fixed matching minor. Our result builds on a a tight relationship between structural digraph theory and matching theory and allows us to deduce a Flat Wall Theorem for digraphs which substantially differs from a previously established directed variant of this theorem.


title: Looper: An end-to-end ML platform for product decisions

abstract: Modern software systems and products increasingly rely on machine learning models to make data-driven decisions based on interactions with users, infrastructure and other systems. For broader adoption, this practice must (i) accommodate product engineers without ML backgrounds, (ii) support finegrain product-metric evaluation and (iii) optimize for product goals. To address shortcomings of prior platforms, we introduce general principles for and the architecture of an ML platform, Looper, with simple APIs for decision-making and feedback collection. Looper covers the end-to-end ML lifecycle from collecting training data and model training to deployment and inference, and extends support to personalization, causal evaluation with heterogenous treatment effects, and Bayesian tuning for product goals. During the 2021 production deployment Looper simultaneously hosted 440-1,000 ML models that made 4-6 million real-time decisions per second. We sum up experiences of platform adopters and describe their learning curve.


title: Thermalization of Holographic Excited States

abstract: We propose a real time holographic framework to study thermalization processes of a family of QFT excited states. The construction builds on Skenderis-van Rees's holographic duals to QFT Schwinger-Keldysh complex-time ordered paths. Thermalization is explored choosing a set of observables $F_n$ which essentially isolate the excited state contribution. Focusing on theories defined on compact manifolds and with excited states defined in terms of Euclidean path integrals, we identify boundary conditions that allow to avoid any number of modes in the initial field state. In the large conformal dimensions regime, we give precise prescriptions on how to compute the observables in terms of bulk geodesics.


title: Integer superharmonic matrices on the $F$-lattice

abstract: We prove that the set of quadratic growths achievable by integer superharmonic functions on the $F$-lattice, a periodic subgraph of the square lattice with oriented edges, has the structure of an overlapping circle packing. The proof recursively constructs a distinct pair of recurrent functions for each rational point on a hyperbola. This proves a conjecture of Smart (2013) and completely describes the scaling limit of the Abelian sandpile on the $F$-lattice.


title: AIR-Net: Adaptive and Implicit Regularization Neural Network for Matrix Completion

abstract: The explicit low-rank regularization, e.g., nuclear norm regularization, has been widely used in imaging sciences. However, it has been found that implicit regularization outperforms explicit ones in various image processing tasks. Another issue is that the fixed explicit regularization limits the applicability to broad images since different images favor different features captured by different explicit regularizations. As such, this paper proposes a new adaptive and implicit low-rank regularization that captures the low-rank prior dynamically from the training data. The core of our new adaptive and implicit low-rank regularization is parameterizing the Laplacian matrix in the Dirichlet energy-based regularization, which we call the regularization \textit{AIR}. Theoretically, we show that the adaptive regularization of AIR enhances the implicit regularization and vanishes at the end of training. We validate AIR's effectiveness on various benchmark tasks, indicating that the AIR is particularly favorable for the scenarios when the missing entries are non-uniform. The code can be found at https://github.com/lizhemin15/AIR-Net


title: On a property of Herglotz functions

abstract: In this note I prove the following property of Herglotz functions, which to my knowledge is new: For a Herglotz function $h(z)$ and a real number $r \in \mathbb R$ define a Herglotz function $g_r(z) = (r - h(z))^{-1}.$ Let $\mu_r^{(s)}$ be the singular part of the measure $\mu_r$ which corresponds to $g_r(z)$ via the Herglotz representation theorem. Then the measure $\int_0^1 \mu_r^{(s)}\,dr$ is absolutely continuous, its density is integer-valued a.e., and moreover the density takes values $0$ or $1$ a.e.


title: PI -- Terminal Planetary Defense

abstract: We present a practical and effective method of planetary defense that allows for extremely short mitigation time scales if required as well as long time scale mitigation. This one system allows for virtually any required defense mode. In general, it uses much less launch mass with vastly short required response time than classical deflection techniques The method uses an array of small hypervelocity kinetic penetrators that pulverize and disassemble an asteroid or small comet. This approach will work in extended time scale modes where there is a large warning time, as well as in short interdiction time scenarios with intercepts of minutes to days before impact. In longer time intercept scenarios, the disassembled asteroid fragments largely miss the Earth. In short intercept scenarios, the asteroid fragments of maximum $\sim$10-meter diameter allow the Earth's atmosphere to act as a "beam dump" where the fragments burn up and/or air burst, with the primary channel of energy going into spatially and temporally de-correlated shock waves. The de-correlated blast waves are the key to why PI works so well. The effectiveness of the approach depends on the intercept time and size of the asteroid but allows for effective defense against asteroids in the 20-1000m diameter class and could virtually eliminate the threat of mass destruction posed by these threats with very short warning times, though longer warning is always preferred. A 20m diameter asteroid ($\sim$0.5Mt, similar to Chelyabinsk) can be mitigated with a 100s prior to impact intercept with a 10m/s disruption. With ~1m/s internal disruption, a 5 hours prior to impact intercept of a 50m diameter asteroid ($\sim$10Mt yield, similar to Tunguska), a 1 day prior to impact intercept of 100m diameter asteroid ($\sim$100Mt yield), a 20 day prior to impact intercept of Apophis ($\sim$370m diameter, $\sim$4Gt yield) mitigates these threats.


title: Composable Sparse Fine-Tuning for Cross-Lingual Transfer

abstract: Fine-tuning the entire set of parameters of a large pretrained model has become the mainstream approach for transfer learning. To increase its efficiency and prevent catastrophic forgetting and interference, techniques like adapters and sparse fine-tuning have been developed. Adapters are modular, as they can be combined to adapt a model towards different facets of knowledge (e.g., dedicated language and/or task adapters). Sparse fine-tuning is expressive, as it controls the behavior of all model components. In this work, we introduce a new fine-tuning method with both these desirable properties. In particular, we learn sparse, real-valued masks based on a simple variant of the Lottery Ticket Hypothesis. Task-specific masks are obtained from annotated data in a source language, and language-specific masks from masked language modeling in a target language. Both these masks can then be composed with the pretrained model. Unlike adapter-based fine-tuning, this method neither increases the number of parameters at inference time nor alters the original model architecture. Most importantly, it outperforms adapters in zero-shot cross-lingual transfer by a large margin in a series of multilingual benchmarks, including Universal Dependencies, MasakhaNER, and AmericasNLI. Based on an in-depth analysis, we additionally find that sparsity is crucial to prevent both 1) interference between the fine-tunings to be composed and 2) overfitting. We release the code and models at https://github.com/cambridgeltl/composable-sft.


title: Quantum state preparation, tomography, and entanglement of mechanical oscillators

abstract: Precisely engineered mechanical oscillators keep time, filter signals, and sense motion, making them an indispensable part of today's technological landscape. These unique capabilities motivate bringing mechanical devices into the quantum domain by interfacing them with engineered quantum circuits. Proposals to combine microwave-frequency mechanical resonators with superconducting devices suggest the possibility of powerful quantum acoustic processors. Meanwhile, experiments in several mechanical systems have demonstrated quantum state control and readout, phonon number resolution, and phonon-mediated qubit-qubit interactions. Currently, these acoustic platforms lack processors capable of controlling multiple mechanical oscillators' quantum states with a single qubit, and the rapid quantum non-demolition measurements of mechanical states needed for error correction. Here we use a superconducting qubit to control and read out the quantum state of a pair of nanomechanical resonators. Our device is capable of fast qubit-mechanics swap operations, which we use to deterministically manipulate the mechanical states. By placing the qubit into the strong dispersive regime with both mechanical resonators simultaneously, we determine the resonators' phonon number distributions via Ramsey measurements. Finally, we present quantum tomography of the prepared nonclassical and entangled mechanical states. Our result represents a concrete step toward feedback-based operation of a quantum acoustic processor.


title: Black hole solutions and thin shells in N-dimensional F(R) gravity with a conformally invariant Maxwell field

abstract: We present a generalization of the black hole solution with spherical symmetry already known in the literature for $N$-dimensional $F(R)$ gravity with a conformally invariant Maxwell field and constant scalar curvature $R$. This solution also includes a generalization of the one corresponding to general relativity as a special case. We introduce the formalism for the construction of a broad family of spherically symmetric thin shells in $F(R)$ theory. We use our generalized solution in order to provide examples of bubbles and thin layers of matter surrounding black holes. We analyze the stability of the constructions under perturbations preserving the symmetry, finding that stable configurations are possible for suitable values of the parameters. We show that the extension to higher dimensions does not alter the qualitative behavior of the thin shells found in four dimensions, with the main difference being a change of scale for the different values of $N$.


title: Topological charge-entropy scaling in kagome Chern magnet TbMn$_6$Sn$_6$

abstract: In ordinary materials, electrons conduct both electricity and heat, where their charge-entropy relations observe the Mott formula and the Wiedemann-Franz law. In topological quantum materials, the transverse motion of relativistic electrons can be strongly affected by the quantum field arising around the topological fermions, where a simple model description of their charge-entropy relations remains elusive. Here we report the topological charge-entropy scaling in the kagome Chern magnet TbMn$_6$Sn$_6$, featuring pristine Mn kagome lattices with strong out-of-plane magnetization. Through both electric and thermoelectric transports, we observe quantum oscillations with a nontrivial Berry phase, a large Fermi velocity and two-dimensionality, supporting the existence of Dirac fermions in the magnetic kagome lattice. This quantum magnet further exhibits large anomalous Hall, anomalous Nernst, and anomalous thermal Hall effects, all of which persist to above room temperature. Remarkably, we show that the charge-entropy scaling relations of these anomalous transverse transports can be ubiquitously described by the Berry curvature field effects in a Chern-gapped Dirac model. Our work points to a model kagome Chern magnet for the proof-of-principle elaboration of the topological charge-entropy scaling.


title: Efficient valley polarization of charged excitons and resident carriers in MoS2 monolayers by optical pumping

abstract: We investigate with polarized microphotoluminescence the optical pumping of the valley degree of freedom in charge-tunable MoS2 monolayers encapsulated with hexagonal boron nitride at cryogenic temperatures. We report a large steady state valley polarization of the different excitonic complexes following circularly-polarized laser excitation 25 meV above the neutral exciton transition. For the first time in this material we reveal efficient valley pumping of positively-charged trions, which were so far elusive in non-encapsulated monolayers due to defect and laser-induced large electron doping. We find that negatively-charged trions present a polarization of 70 % which is unusually large for non-resonant excitation. We attribute this large valley polarization to the particular band structure of MoS2, where an optically dark exciton ground state coexists with a bright conduction band ordering in the single-particle picture, leading to a supression of the valley relaxation for negatively-charged trions. In addition, we demonstrate that circular excitation induces a dynamical polarization of resident electrons and holes, as recently shown in tungsten-based monolayers. This manifest itself as a variation in the intensity of different excitonic complexes under circular and linear excitation.


title: The extension property for domains with one singular point

abstract: An arbitrary outward cuspidal domain is shown to be bi-Lipschitz equivalent to a Lipschitz outward cuspidal domain via a global transformation. This allows us to extend earlier Sobolev extension results on Lipschitz outward cuspidal domains from the work of Maz'ya and Poborchi to arbitrary outward cuspidal domains. We also establish a limit case of extension results on outward cuspidal domains.


title: Practical Benefits of Feature Feedback Under Distribution Shift

abstract: In attempts to develop sample-efficient and interpretable algorithms, researcher have explored myriad mechanisms for collecting and exploiting feature feedback (or rationales) auxiliary annotations provided for training (but not test) instances that highlight salient evidence. Examples include bounding boxes around objects and salient spans in text. Despite its intuitive appeal, feature feedback has not delivered significant gains in practical problems as assessed on iid holdout sets. However, recent works on counterfactually augmented data suggest an alternative benefit of supplemental annotations, beyond interpretability: lessening sensitivity to spurious patterns and consequently delivering gains in out-of-domain evaluations. We speculate that while existing methods for incorporating feature feedback have delivered negligible in-sample performance gains, they may nevertheless provide out-of-domain benefits. Our experiments addressing sentiment analysis, show that feature feedback methods perform significantly better on various natural out-of-domain datasets despite comparable in-domain evaluations. By contrast, performance on natural language inference remains comparable. Finally, we compare those tasks where feature feedback does (and does not) help.


title: Resource-constrained Federated Edge Learning with Heterogeneous Data: Formulation and Analysis

abstract: Efficient collaboration between collaborative machine learning and wireless communication technology, forming a Federated Edge Learning (FEEL), has spawned a series of next-generation intelligent applications. However, due to the openness of network connections, the FEEL framework generally involves hundreds of remote devices (or clients), resulting in expensive communication costs, which is not friendly to resource-constrained FEEL. To address this issue, we propose a distributed approximate Newton-type algorithm with fast convergence speed to alleviate the problem of FEEL resource (in terms of communication resources) constraints. Specifically, the proposed algorithm is improved based on distributed L-BFGS algorithm and allows each client to approximate the high-cost Hessian matrix by computing the low-cost Fisher matrix in a distributed manner to find a "better" descent direction, thereby speeding up convergence. Second, we prove that the proposed algorithm has linear convergence in strongly convex and non-convex cases and analyze its computational and communication complexity. Similarly, due to the heterogeneity of the connected remote devices, FEEL faces the challenge of heterogeneous data and non-IID (Independent and Identically Distributed) data. To this end, we design a simple but elegant training scheme, namely FedOVA, to solve the heterogeneous statistical challenge brought by heterogeneous data. In this way, FedOVA first decomposes a multi-class classification problem into more straightforward binary classification problems and then combines their respective outputs using ensemble learning. In particular, the scheme can be well integrated with our communication efficient algorithm to serve FEEL. Numerical results verify the effectiveness and superiority of the proposed algorithm.


title: Clear evidence against superconductivity in hydrides under high pressure

abstract: The Meissner effect, magnetic field expulsion, is a hallmark of superconductivity. Associated with it, superconductors exclude applied magnetic fields. Recently Minkov et al. presented experimental results reportedly showing "definitive evidence of the Meissner effect" in sulfur hydride and lanthanum hydride under high pressure [1], and more recently Eremets et al. argued that "the arguments against superconductivity (in hydrides) can be either refuted or explained" [2]. Instead, we show here that the evidence presented in those papers does not support the case for superconductivity in these materials. Together with experimental evidence discussed in earlier papers, we argue that this strongly suggests that hydrides under pressure are not high-temperature superconductors.


title: BD-$\Lambda$CDM and Running Vacuum Models: Theoretical background and current observational status

abstract: We present an analysis of the Brans-Dicke cosmological model with a cosmological constant and cold dark matter (BD-$\Lambda$CDM). We find that the BD-$\Lambda$CDM is favored by the overall cosmological data (SNIa+BAO+$H(z)$+LSS+CMB) when it is compared with the standard model of cosmology. The BD-$\Lambda$CDM model can be viewed from the GR perspective as a Running Vacuum Model (RVM) with a time evolving vacuum energy density. Due to this fact and also to its time evolving effective gravitational coupling, the model can alleviate the $\sigma_8$ and the $H_0$ tensions at a time. We also present the results for different types of RVM's when they are tested in the light of the cosmological data and we show that a mild dynamics for the vacuum energy density can help to smooth out the aforementioned tensions, thus improving the performance of $\Lambda$CDM model.


title: MGC: A Complex-Valued Graph Convolutional Network for Directed Graphs

abstract: Recent advancements in Graph Neural Networks have led to state-of-the-art performance on graph representation learning. However, the majority of existing works process directed graphs by symmetrization, which causes loss of directional information. To address this issue, we introduce the magnetic Laplacian, a discrete Schr\"odinger operator with magnetic field, which preserves edge directionality by encoding it into a complex phase with an electric charge parameter. By adopting a truncated variant of PageRank named Linear- Rank, we design and build a low-pass filter for homogeneous graphs and a high-pass filter for heterogeneous graphs. In this work, we propose a complex-valued graph convolutional network named Magnetic Graph Convolutional network (MGC). With the corresponding complex-valued techniques, we ensure our model will be degenerated into real-valued when the charge parameter is in specific values. We test our model on several graph datasets including directed homogeneous and heterogeneous graphs. The experimental results demonstrate that MGC is fast, powerful, and widely applicable.


title: String structures, 2-group bundles, and a categorification of the Freed-Quinn line bundle

abstract: For a 2-group constructed from a finite group and 3-cocycle, we provide an explicit description of the bicategory of flat 2-group bundles on an oriented surface in terms of weak representations of the fundamental group. We show that this bicategory encodes (flat) string structures. Furthermore, we identify the space of isomorphism classes of objects with Freed and Quinn's line bundle appearing in Chern-Simons theory of a finite group.


title: LAGr: Labeling Aligned Graphs for Improving Systematic Generalization in Semantic Parsing

abstract: Semantic parsing is the task of producing a structured meaning representation for natural language utterances or questions. Recent research has pointed out that the commonly-used sequence-to-sequence (seq2seq) semantic parsers struggle to generalize systematically, i.e. to handle examples that require recombining known knowledge in novel settings. In this work, we show that better systematic generalization can be achieved by producing the meaning representation (MR) directly as a graph and not as a sequence. To this end we propose LAGr, the Labeling Aligned Graphs algorithm that produces semantic parses by predicting node and edge labels for a complete multi-layer input-aligned graph. The strongly-supervised LAGr algorithm requires aligned graphs as inputs, whereas weakly-supervised LAGr infers alignments for originally unaligned target graphs using an approximate MAP inference procedure. On the COGS and CFQ compositional generalization benchmarks the strongly- and weakly- supervised LAGr algorithms achieve significant improvements upon the baseline seq2seq parsers.


title: Generating stochastic trajectories with global dynamical constraints

abstract: We propose a method to exactly generate Brownian paths $x_c(t)$ that are constrained to return to the origin at some future time $t_f$, with a given fixed area $A_f = \int_0^{t_f}dt\, x_c(t)$ under their trajectory. We derive an exact effective Langevin equation with an effective force that accounts for the constraint. In addition, we develop the corresponding approach for discrete-time random walks, with arbitrary jump distributions including L\'evy flights, for which we obtain an effective jump distribution that encodes the constraint. Finally, we generalise our method to other types of dynamical constraints such as a fixed occupation time on the positive axis $T_f=\int_0^{t_f}dt\, \Theta\left[x_c(t)\right]$ or a fixed generalised quadratic area $\mathcal{A}_f=\int_0^{t_f}dt \,x_c^2(t)$.


title: Can Machines Learn Morality? The Delphi Experiment

abstract: As AI systems become increasingly powerful and pervasive, there are growing concerns about machines' morality or a lack thereof. Yet, teaching morality to machines is a formidable task, as morality remains among the most intensely debated questions in humanity, let alone for AI. Existing AI systems deployed to millions of users, however, are already making decisions loaded with moral implications, which poses a seemingly impossible challenge: teaching machines moral sense, while humanity continues to grapple with it. To explore this challenge, we introduce Delphi, an experimental framework based on deep neural networks trained directly to reason about descriptive ethical judgments, e.g., "helping a friend" is generally good, while "helping a friend spread fake news" is not. Empirical results shed novel insights on the promises and limits of machine ethics; Delphi demonstrates strong generalization capabilities in the face of novel ethical situations, while off-the-shelf neural network models exhibit markedly poor judgment including unjust biases, confirming the need for explicitly teaching machines moral sense. Yet, Delphi is not perfect, exhibiting susceptibility to pervasive biases and inconsistencies. Despite that, we demonstrate positive use cases of imperfect Delphi, including using it as a component model within other imperfect AI systems. Importantly, we interpret the operationalization of Delphi in light of prominent ethical theories, which leads us to important future research questions.


title: Spoken ObjectNet: A Bias-Controlled Spoken Caption Dataset

abstract: Visually-grounded spoken language datasets can enable models to learn cross-modal correspondences with very weak supervision. However, modern audio-visual datasets contain biases that undermine the real-world performance of models trained on that data. We introduce Spoken ObjectNet, which is designed to remove some of these biases and provide a way to better evaluate how effectively models will perform in real-world scenarios. This dataset expands upon ObjectNet, which is a bias-controlled image dataset that features similar image classes to those present in ImageNet. We detail our data collection pipeline, which features several methods to improve caption quality, including automated language model checks. Lastly, we show baseline results on image retrieval and audio retrieval tasks. These results show that models trained on other datasets and then evaluated on Spoken ObjectNet tend to perform poorly due to biases in other datasets that the models have learned. We also show evidence that the performance decrease is due to the dataset controls, and not the transfer setting.


title: Deterministic photon storage and readout in a semimagnetic quantum-dot--cavity system doped with a single Mn ion

abstract: Light trapping is a crucial mechanism for synchronization in optical communication. Especially on the level of single photons, control of the exact emission time is desirable. In this paper, we theoretically propose a single-photon buffering device composed of a quantum dot doped with a single Mn atom in a cavity. We present a method to detain a single cavity photon as an excitation of the dot. The storage scheme is based on bright to dark exciton conversion performed with an off-resonant external optical field and mediated via a spin-flip with the magnetic ion. The induced Stark shift brings both exciton states to resonance and results in an excitation transfer to the optically inactive one. The stored photon can be read out on demand in the same manner by repopulating the bright state, which has a short lifetime. Our results indicate the possibility to suspend a photon for almost two orders of magnitude longer than the lifetime of the bright exciton.


title: UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning

abstract: Recent parameter-efficient language model tuning (PELT) methods manage to match the performance of fine-tuning with much fewer trainable parameters and perform especially well when training data is limited. However, different PELT methods may perform rather differently on the same task, making it nontrivial to select the most appropriate method for a specific task, especially considering the fast-growing number of new PELT methods and tasks. In light of model diversity and the difficulty of model selection, we propose a unified framework, UniPELT, which incorporates different PELT methods as submodules and learns to activate the ones that best suit the current data or task setup via gating mechanism. On the GLUE benchmark, UniPELT consistently achieves 1~4% gains compared to the best individual PELT method that it incorporates and even outperforms fine-tuning under different setups. Moreover, UniPELT generally surpasses the upper bound that takes the best performance of all its submodules used individually on each task, indicating that a mixture of multiple PELT methods may be inherently more effective than single methods.


title: Learning Temporal 3D Human Pose Estimation with Pseudo-Labels

abstract: We present a simple, yet effective, approach for self-supervised 3D human pose estimation. Unlike the prior work, we explore the temporal information next to the multi-view self-supervision. During training, we rely on triangulating 2D body pose estimates of a multiple-view camera system. A temporal convolutional neural network is trained with the generated 3D ground-truth and the geometric multi-view consistency loss, imposing geometrical constraints on the predicted 3D body skeleton. During inference, our model receives a sequence of 2D body pose estimates from a single-view to predict the 3D body pose for each of them. An extensive evaluation shows that our method achieves state-of-the-art performance in the Human3.6M and MPI-INF-3DHP benchmarks. Our code and models are publicly available at \url{https://github.com/vru2020/TM_HPE/}.


title: Diffusion Normalizing Flow

abstract: We present a novel generative modeling method called diffusion normalizing flow based on stochastic differential equations (SDEs). The algorithm consists of two neural SDEs: a forward SDE that gradually adds noise to the data to transform the data into Gaussian random noise, and a backward SDE that gradually removes the noise to sample from the data distribution. By jointly training the two neural SDEs to minimize a common cost function that quantifies the difference between the two, the backward SDE converges to a diffusion process the starts with a Gaussian distribution and ends with the desired data distribution. Our method is closely related to normalizing flow and diffusion probabilistic models and can be viewed as a combination of the two. Compared with normalizing flow, diffusion normalizing flow is able to learn distributions with sharp boundaries. Compared with diffusion probabilistic models, diffusion normalizing flow requires fewer discretization steps and thus has better sampling efficiency. Our algorithm demonstrates competitive performance in both high-dimension data density estimation and image generation tasks.


title: Graph Condensation for Graph Neural Networks

abstract: Given the prevalence of large-scale graphs in real-world applications, the storage and time for training neural models have raised increasing concerns. To alleviate the concerns, we propose and study the problem of graph condensation for graph neural networks (GNNs). Specifically, we aim to condense the large, original graph into a small, synthetic and highly-informative graph, such that GNNs trained on the small graph and large graph have comparable performance. We approach the condensation problem by imitating the GNN training trajectory on the original graph through the optimization of a gradient matching loss and design a strategy to condense node futures and structural information simultaneously. Extensive experiments have demonstrated the effectiveness of the proposed framework in condensing different graph datasets into informative smaller graphs. In particular, we are able to approximate the original test accuracy by 95.3% on Reddit, 99.8% on Flickr and 99.0% on Citeseer, while reducing their graph size by more than 99.9%, and the condensed graphs can be used to train various GNN architectures.Code is released at https://github.com/ChandlerBang/GCond.


title: Zero-Shot Dense Retrieval with Momentum Adversarial Domain Invariant Representations

abstract: Dense retrieval (DR) methods conduct text retrieval by first encoding texts in the embedding space and then matching them by nearest neighbor search. This requires strong locality properties from the representation space, i.e, the close allocations of each small group of relevant texts, which are hard to generalize to domains without sufficient training data. In this paper, we aim to improve the generalization ability of DR models from source training domains with rich supervision signals to target domains without any relevant labels, in the zero-shot setting. To achieve that, we propose Momentum adversarial Domain Invariant Representation learning (MoDIR), which introduces a momentum method in the DR training process to train a domain classifier distinguishing source versus target, and then adversarially updates the DR encoder to learn domain invariant representations. Our experiments show that MoDIR robustly outperforms its baselines on 10+ ranking datasets from the BEIR benchmark in the zero-shot setup, with more than 10% relative gains on datasets with enough sensitivity for DR models' evaluation. Source code of this paper will be released.


title: Network Representation Learning: From Preprocessing, Feature Extraction to Node Embedding

abstract: Network representation learning (NRL) advances the conventional graph mining of social networks, knowledge graphs, and complex biomedical and physics information networks. Over dozens of network representation learning algorithms have been reported in the literature. Most of them focus on learning node embeddings for homogeneous networks, but they differ in the specific encoding schemes and specific types of node semantics captured and used for learning node embedding. This survey paper reviews the design principles and the different node embedding techniques for network representation learning over homogeneous networks. To facilitate the comparison of different node embedding algorithms, we introduce a unified reference framework to divide and generalize the node embedding learning process on a given network into preprocessing steps, node feature extraction steps and node embedding model training for a NRL task such as link prediction and node clustering. With this unifying reference framework, we highlight the representative methods, models, and techniques used at different stages of the node embedding model learning process. This survey not only helps researchers and practitioners to gain an in-depth understanding of different network representation learning techniques but also provides practical guidelines for designing and developing the next generation of network representation learning algorithms and systems.


title: Near optimal sample complexity for matrix and tensor normal models via geodesic convexity

abstract: The matrix normal model, the family of Gaussian matrix-variate distributions whose covariance matrix is the Kronecker product of two lower dimensional factors, is frequently used to model matrix-variate data. The tensor normal model generalizes this family to Kronecker products of three or more factors. We study the estimation of the Kronecker factors of the covariance matrix in the matrix and tensor models. We show nonasymptotic bounds for the error achieved by the maximum likelihood estimator (MLE) in several natural metrics. In contrast to existing bounds, our results do not rely on the factors being well-conditioned or sparse. For the matrix normal model, all our bounds are minimax optimal up to logarithmic factors, and for the tensor normal model our bound for the largest factor and overall covariance matrix are minimax optimal up to constant factors provided there are enough samples for any estimator to obtain constant Frobenius error. In the same regimes as our sample complexity bounds, we show that an iterative procedure to compute the MLE known as the flip-flop algorithm converges linearly with high probability. Our main tool is geodesic strong convexity in the geometry on positive-definite matrices induced by the Fisher information metric. This strong convexity is determined by the expansion of certain random quantum channels. We also provide numerical evidence that combining the flip-flop algorithm with a simple shrinkage estimator can improve performance in the undersampled regime.


title: Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop

abstract: This paper investigates unsupervised learning of Full-Waveform Inversion (FWI), which has been widely used in geophysics to estimate subsurface velocity maps from seismic data. This problem is mathematically formulated by a second order partial differential equation (PDE), but is hard to solve. Moreover, acquiring velocity map is extremely expensive, making it impractical to scale up a supervised approach to train the mapping from seismic data to velocity maps with convolutional neural networks (CNN). We address these difficulties by integrating PDE and CNN in a loop, thus shifting the paradigm to unsupervised learning that only requires seismic data. In particular, we use finite difference to approximate the forward modeling of PDE as a differentiable operator (from velocity map to seismic data) and model its inversion by CNN (from seismic data to velocity map). Hence, we transform the supervised inversion task into an unsupervised seismic data reconstruction task. We also introduce a new large-scale dataset OpenFWI, to establish a more challenging benchmark for the community. Experiment results show that our model (using seismic data alone) yields comparable accuracy to the supervised counterpart (using both seismic data and velocity map). Furthermore, it outperforms the supervised model when involving more seismic data.


title: Differential graded algebras for trivalent plane graphs and their representations

abstract: To any trivalent plane graph embedded in the sphere, Casals and Murphy associate a differential graded algebra (dg-algebra), in which the underlying graded algebra is free associative over a commutative ring. Our first result is the construction of a generalization of the Casals--Murphy dg-algebra to non-commutative coefficients, for which we prove various functoriality properties not previously verified in the commutative setting. Our second result is to prove that rank $r$ representations of this dg-algebra, over a field $\mathbb{F}$, correspond to colorings of the faces of the graph by elements of the Grassmannian $\operatorname{Gr}(r,2r;\mathbb{F})$ so that bordering faces are transverse, up to the natural action of $\operatorname{PGL}_{2r}(\mathbb{F})$. Underlying the combinatorics, the dg-algebra is a computation of the fully non-commutative Legendrian contact dg-algebra for Legendrian satellites of Legendrian 2-weaves, though we do not prove as such in this paper. The graph coloring problem verifies that for Legendrian 2-weaves, rank $r$ representations of the Legendrian contact dg-algebra correspond to constructible sheaves of microlocal rank $r$. This is the first explicit such computation of the bijection between the moduli spaces of representations and sheaves for an infinite family of Legendrian surfaces.


title: Can Explanations Be Useful for Calibrating Black Box Models?

abstract: NLP practitioners often want to take existing trained models and apply them to data from new domains. While fine-tuning or few-shot learning can be used to adapt a base model, there is no single recipe for making these techniques work; moreover, one may not have access to the original model weights if it is deployed as a black box. We study how to improve a black box model's performance on a new domain by leveraging explanations of the model's behavior. Our approach first extracts a set of features combining human intuition about the task with model attributions generated by black box interpretation techniques, then uses a simple calibrator, in the form of a classifier, to predict whether the base model was correct or not. We experiment with our method on two tasks, extractive question answering and natural language inference, covering adaptation from several pairs of domains with limited target-domain data. The experimental results across all the domain pairs show that explanations are useful for calibrating these models, boosting accuracy when predictions do not have to be returned on every example. We further show that the calibration model transfers to some extent between tasks.


title: KiDS-1000 Cosmology: machine learning -- accelerated constraints on Interacting Dark Energy with COSMOPOWER

abstract: We derive constraints on a coupled quintessence model with pure momentum exchange from the public $\sim$1000 deg$^2$ cosmic shear measurements from the Kilo-Degree Survey and the $\it{Planck}$ 2018 Cosmic Microwave Background data. We compare this model with $\Lambda$CDM and find similar $\chi^2$ and log-evidence values. We accelerate parameter estimation by sourcing cosmological power spectra from the neural network emulator COSMOPOWER. We highlight the necessity of such emulator-based approaches to reduce the computational runtime of future similar analyses, particularly from Stage IV surveys. As an example, we present MCMC forecasts on the same coupled quintessence model for a $\it{Euclid}$-like survey, revealing degeneracies between the coupled quintessence parameters and the baryonic feedback and intrinsic alignment parameters, but also highlighting the large increase in constraining power Stage IV surveys will achieve. The contours are obtained in a few hours with COSMOPOWER, as opposed to the few months required with a Boltzmann code.


title: Playing for 3D Human Recovery

abstract: Image- and video-based 3D human recovery (i.e., pose and shape estimation) have achieved substantial progress. However, due to the prohibitive cost of motion capture, existing datasets are often limited in scale and diversity. In this work, we obtain massive human sequences by playing the video game with automatically annotated 3D ground truths. Specifically, we contribute GTA-Human, a large-scale 3D human dataset generated with the GTA-V game engine, featuring a highly diverse set of subjects, actions, and scenarios. More importantly, we study the use of game-playing data and obtain five major insights. First, game-playing data is surprisingly effective. A simple frame-based baseline trained on GTA-Human outperforms more sophisticated methods by a large margin. For video-based methods, GTA-Human is even on par with the in-domain training set. Second, we discover that synthetic data provides critical complements to the real data that is typically collected indoor. Our investigation into domain gap provides explanations for our data mixture strategies that are simple yet useful. Third, the scale of the dataset matters. The performance boost is closely related to the additional data available. A systematic study reveals the model sensitivity to data density from multiple key aspects. Fourth, the effectiveness of GTA-Human is also attributed to the rich collection of strong supervision labels (SMPL parameters), which are otherwise expensive to acquire in real datasets. Fifth, the benefits of synthetic data extend to larger models such as deeper convolutional neural networks (CNNs) and Transformers, for which a significant impact is also observed. We hope our work could pave the way for scaling up 3D human recovery to the real world. Homepage: https://caizhongang.github.io/projects/GTA-Human/


title: A spin foam framework for the black-to-white hole transition

abstract: Black holes formation and evolution have been extensively studied at the classical level. However, not much is known regarding the end of their lives, a phase that requires to consider the quantum nature of the gravitational field. A black-to-white hole transition can capture the physics of this phenomenon, in particular the physics of the residual small black holes at the end of the Hawking evaporation. This work shows how the spin foam formalism is able to describe this non-perturbative phenomenon. A thorough examination of the black hole spacetime region in which quantum effects cannot be neglected indicates that the scenario in which the black hole geometry undergoes a quantum transition in a white hole geometry is natural and conservative. This quantum transition is then studied using the spin foam formalism and the resulting transition amplitude is explicitly computed.


title: DIISC-II: Unveiling the Connections between Star Formation and ISM in the Extended Ultraviolet Disk of NGC 3344

abstract: We present our investigation of the Extended Ultraviolet (XUV) disk galaxy, NGC 3344, conducted as part of Deciphering the Interplay between the Interstellar medium, Stars, and the Circumgalactic medium (DIISC) survey. We use surface and aperture photometry of individual young stellar complexes to study star formation and its effect on the physical properties of the interstellar medium. We measure the specific star-formation rate (sSFR) and find it to increase from $\rm10^{-10} yr^{-1}$ in the inner disk to $\rm>10^{-8} yr^{-1}$ in the extended disk. This provides evidence for inside-out disk growth. If these sSFRs are maintained, the XUV disk stellar mass can double in $\sim$0.5 Gyr, suggesting a burst of star formation. The XUV disk will continue forming stars for a long time due to the high gas depletion times ($\tau_{dep}$). The stellar complexes in the XUV disk have high-$\Sigma_{HI}$ and low-$\Sigma_{SFR}$ with $\tau_{dep}\sim$10 Gyrs, marking the onset of a deviation from the traditional Kennicutt-Schmidt law. We find that both far-ultraviolet (FUV) and a combination of FUV and 24$\mu$m effectively trace star formation in the XUV disk. H$\alpha$ is weaker in general and prone to stochasticities in the formation of massive stars. Investigation of the circumgalactic medium at 29.5 kpc resulted in the detection of two absorbing systems with metal-line species: the stronger absorption component is consistent with gas flows around the disk, most likely tracing inflow, while the weaker component is likely tracing corotating circumgalactic gas.


title: GKM spaces, and the signed positivity of the nabla operator

abstract: We show that the Frobenius character of the equivariant Borel-Moore homology of a certain positive $GL_n$-version of the unramified affine Springer fiber $Z_k$ studied by Goreski, Kottwitz and MacPherson is computed by the matrix coefficients of the $\nabla^k$-operator, which acts diagonally in the modified Macdonald basis. We do this by relating the combinatorial formula for the $\nabla^k$-operator we obtained in an earlier paper to the GKM paving of $Z_k$, and we give an algebraic presentation of the above homology as an explicit submodule of the Kostant-Kumar nil Hecke algebra. We then study a certain open locus $U_k \subset Z_k$, and reduce a long-standing conjecture of Bergeron, Garsia, Haiman and Tesler, which predicts the sign of the coefficients of the Schur expansion of $\nabla^k$, to a vanishing conjecture about the homology groups of $U_k$. The latter conjecture is in turn reduced to a vanishing conjecture for certain open loci of the regular semisimple Hessenberg varieties which are indexed by partial Dyck paths.


title: DeToxy: A Large-Scale Multimodal Dataset for Toxicity Classification in Spoken Utterances

abstract: Toxic speech, also known as hate speech, is regarded as one of the crucial issues plaguing online social media today. Most recent work on toxic speech detection is constrained to the modality of text and written conversations with very limited work on toxicity detection from spoken utterances or using the modality of speech. In this paper, we introduce a new dataset DeToxy, the first publicly available toxicity annotated dataset for the English language. DeToxy is sourced from various openly available speech databases and consists of over 2 million utterances. We believe that our dataset would act as a benchmark for the relatively new and un-explored Spoken Language Processing task of detecting toxicity from spoken utterances and boost further research in this space. Finally, we also provide strong unimodal baselines for our dataset and compare traditional two-step and E2E approaches. Our experiments show that in the case of spoken utterances, text-based approaches are largely dependent on gold human-annotated transcripts for their performance and also suffer from the problem of keyword bias. However, the presence of speech files in DeToxy helps facilitates the development of E2E speech models which alleviate both the above-stated problems by better capturing speech clues.


title: Charge order and superconductivity in a minimal two-band model for infinite-layer nickelates

abstract: The recent discovery of superconductivity in infinite-layer nickelates has drawn considerable attention; however, a consensus on the fundamental building blocks and common ingredients necessary to understand and describe their ground states and emergent properties is lacking. A series of experimental and theoretical studies have suggested that an effective two-band Hubbard model with Ni 3$d_{x^2-y^2}$ and rare-earth ($R$) 5$d$ character may describe the low-energy physics. Here, we study the ground state properties of this two-band model on four-leg cylinders using the density-matrix renormalization group (DMRG) technique to better grasp whether such a simple model can embody the essential physics. A key difference compared to single-band Hubbard materials is that the system is self-doped: even at overall half-filling, the $R$-band acts as an electron reservoir, hole-doping the Ni-layer and fundamentally altering the physics expected from an undoped antiferromagnet. On the four-leg cylinder, the ground state is consistent with a Luttinger liquid, with anti-phase modulations of the charge density in the Ni- and $R$-layers having corresponding wavevectors that lock together. Light hole doping away from 1/2 filling releases the locking between the Ni and the $R$ charge modulations, as the electron density in the $R$-band decreases and eventually becomes exhausted at a hole doping concentration that depends sensitively on the effective splitting between the Ni and the $R$ orbitals. The ground state of the doped system is consistent with a Luther-Emery liquid, possessing quasi-long-range superconducting correlations in the Ni layer, similar to the single-band Hubbard model. Our results are consistent with experimental observations and may help to reveal the microscopic mechanism for pairing and other emergent properties.


title: The Neural MMO Platform for Massively Multiagent Research

abstract: Neural MMO is a computationally accessible research platform that combines large agent populations, long time horizons, open-ended tasks, and modular game systems. Existing environments feature subsets of these properties, but Neural MMO is the first to combine them all. We present Neural MMO as free and open source software with active support, ongoing development, documentation, and additional training, logging, and visualization tools to help users adapt to this new setting. Initial baselines on the platform demonstrate that agents trained in large populations explore more and learn a progression of skills. We raise other more difficult problems such as many-team cooperation as open research questions which Neural MMO is well-suited to answer. Finally, we discuss current limitations of the platform, potential mitigations, and plans for continued development.


title: Compressibility of Distributed Document Representations

abstract: Contemporary natural language processing (NLP) revolves around learning from latent document representations, generated either implicitly by neural language models or explicitly by methods such as doc2vec or similar. One of the key properties of the obtained representations is their dimension. Whilst the commonly adopted dimensions of 256 and 768 offer sufficient performance on many tasks, it is many times unclear whether the default dimension is the most suitable choice for the subsequent downstream learning tasks. Furthermore, representation dimensions are seldom subject to hyperparameter tuning due to computational constraints. The purpose of this paper is to demonstrate that a surprisingly simple and efficient recursive compression procedure can be sufficient to both significantly compress the initial representation, but also potentially improve its performance when considering the task of text classification. Having smaller and less noisy representations is the desired property during deployment, as orders of magnitude smaller models can significantly reduce the computational overload and with it the deployment costs. We propose CoRe, a straightforward, representation learner-agnostic framework suitable for representation compression. The CoRe's performance is showcased and studied on a collection of 17 real-life corpora from biomedical, news, social media, and literary domains. We explored CoRe's behavior when considering contextual and non-contextual document representations, different compression levels, and 9 different compression algorithms. Current results based on more than 100,000 compression experiments indicate that recursive Singular Value Decomposition offers a very good trade-off between the compression efficiency and performance, making CoRe useful in many existing, representation-dependent NLP pipelines.


title: Retrieval-guided Counterfactual Generation for QA

abstract: Deep NLP models have been shown to learn spurious correlations, leaving them brittle to input perturbations. Recent work has shown that counterfactual or contrastive data -- i.e. minimally perturbed inputs -- can reveal these weaknesses, and that data augmentation using counterfactuals can help ameliorate them. Proposed techniques for generating counterfactuals rely on human annotations, perturbations based on simple heuristics, and meaning representation frameworks. We focus on the task of creating counterfactuals for question answering, which presents unique challenges related to world knowledge, semantic diversity, and answerability. To address these challenges, we develop a Retrieve-Generate-Filter(RGF) technique to create counterfactual evaluation and training data with minimal human supervision. Using an open-domain QA framework and question generation model trained on original task data, we create counterfactuals that are fluent, semantically diverse, and automatically labeled. Data augmentation with RGF counterfactuals improves performance on out-of-domain and challenging evaluation sets over and above existing methods, in both the reading comprehension and open-domain QA settings. Moreover, we find that RGF data leads to significant improvements in a model's robustness to local perturbations.


title: A Lattice Model for Super LLT Polynomials

abstract: We introduce a solvable lattice model for supersymmetric LLT polynomials, also known as super LLT polynomials, based upon particle interactions in super n-ribbon tableaux. Using operators on a Fock space, we prove a Cauchy identity for super LLT polynomials, simultaneously generalizing the Cauchy and dual Cauchy identities for LLT polynomials. Lastly, we construct a solvable semi-infinite Cauchy lattice model with a surprising Yang-Baxter equation and examine its connections to the Cauchy identity.


title: The universality of islands outside the horizon

abstract: We systematically calculate the quantum extremal surface (QES) associated with Hawking radiation for general $D$-dimensional ($D\geq2$) asymptotically flat (or AdS) eternal black holes using the island formula. We collect the Hawking radiation particles by a non-gravitational bath and find that a QES exists in the near-horizon region outside the black hole when $c\cdot G_{(D)}$ is smaller enough where $c$ is the central charge of the conformal matter and $G_{(D)}$ the $D$-dimensional Newton constant. The locations of the QES in these backgrounds are obtained and the late-time radiation entropy saturates the two times of black hole entropy. Finally, we numerically check that the no island configuration exists once $c\cdot G_{(D)}$ exceeds a certain upper bound in two-dimensional generalized dilaton theories (GDT). When $c\cdot G_{(D)}$ is close to the upper bound, the backreaction of the matter field on the background can not be neglected. We also consider the conditions of existence of the island configuration with the backreaction and prove that the upper bound also exists for the Witten black hole and Weyl-related Witten black hole.


title: Pivot Hamiltonians as generators of symmetry and entanglement

abstract: It is well-known that symmetry-protected topological (SPT) phases can be obtained from the trivial phase by an entangler, a finite-depth unitary operator $U$. Here, we consider obtaining the entangler from a local 'pivot' Hamiltonian $H_{piv}$ such that $U = e^{i\pi H_{piv}}$. This perspective of Hamiltonians pivoting between the trivial and SPT phase opens up two new directions which we explore here. (i) Since SPT Hamiltonians and entanglers are now on the same footing, can we iterate this process to create other interesting states? (ii) Since entanglers are known to arise as discrete symmetries at SPT transitions, under what conditions can this be enhanced to $U(1)$ 'pivot' symmetry generated by $H_{piv}$? In this work we explore both of these questions. With regard to the first, we give examples of a rich web of dualities obtained by iteratively using an SPT model as a pivot to generate the next one. For the second question, we derive a simple criterion guaranteeing that the direct interpolation between the trivial and SPT Hamiltonian has a $U(1)$ pivot symmetry. We illustrate this in a variety of examples, assuming various forms for $H_{piv}$, including the Ising chain, and the toric code Hamiltonian. A remarkable property of such a $U(1)$ pivot symmetry is that it shares a mutual anomaly with the symmetry protecting the nearby SPT phase. We discuss how such anomalous and non-onsite $U(1)$ symmetries explain the exotic phase diagrams that can appear, including an SPT multicritical point where the gapless ground state is given by the fixed-point toric code state.


title: PointAcc: Efficient Point Cloud Accelerator

abstract: Deep learning on point clouds plays a vital role in a wide range of applications such as autonomous driving and AR/VR. These applications interact with people in real-time on edge devices and thus require low latency and low energy. Compared to projecting the point cloud to 2D space, directly processing the 3D point cloud yields higher accuracy and lower #MACs. However, the extremely sparse nature of point cloud poses challenges to hardware acceleration. For example, we need to explicitly determine the nonzero outputs and search for the nonzero neighbors (mapping operation), which is unsupported in existing accelerators. Furthermore, explicit gather and scatter of sparse features are required, resulting in large data movement overhead. In this paper, we comprehensively analyze the performance bottleneck of modern point cloud networks on CPU/GPU/TPU. To address the challenges, we then present PointAcc, a novel point cloud deep learning accelerator. PointAcc maps diverse mapping operations onto one versatile ranking-based kernel, streams the sparse computation with configurable caching, and temporally fuses consecutive dense layers to reduce the memory footprint. Evaluated on 8 point cloud models across 4 applications, PointAcc achieves 3.7X speedup and 22X energy savings over RTX 2080Ti GPU. Co-designed with light-weight neural networks, PointAcc rivals the prior accelerator Mesorasi by 100X speedup with 9.1% higher accuracy running segmentation on the S3DIS dataset. PointAcc paves the way for efficient point cloud recognition.


title: A road-map to white dwarf pollution: Tidal disruption, eccentric grind-down, and dust accretion

abstract: A significant fraction of white dwarfs show metal lines indicative of pollution with planetary material but the accretion process remains poorly understood. The main aim of this paper is to produce a road-map illustrating several potential routes for white dwarf pollution and to link these paths to observational outcomes. Our proposed main road begins with the tidal disruption of a scattered asteroid and the formation of a highly eccentric tidal disc with a wide range of fragment sizes. Accretion of these fragments by Poynting-Robertson (PR) drag alone is too slow to explain the observed rates. Instead, in the second stage, several processes including differential apsidal precession cause high-velocity collisions between the eccentric fragments. Large asteroids produce more fragments when they disrupt, causing rapid grind-down and generating short and intense bursts of dust production, whereas smaller asteroids grind down over longer periods of time. In the final stage, the collisionally produced dust circularises and accretes onto the white dwarf via drag forces. We show that optically thin dust accretion by PR drag produces large infrared (IR) excesses when the accretion rate exceeds 10^7 g/s. We hypothesise that around white dwarfs accreting at a high rate, but with no detected infrared excess, dust circularisation requires enhanced drag - for instance due to the presence of gas near the disc's pericentre.


title: P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks

abstract: Prompt tuning, which only tunes continuous prompts with a frozen language model, substantially reduces per-task storage and memory usage at training. However, in the context of NLU, prior work reveals that prompt tuning does not perform well for normal-sized pretrained models. We also find that existing methods of prompt tuning cannot handle hard sequence labeling tasks, indicating a lack of universality. We present a novel empirical finding that properly optimized prompt tuning can be universally effective across a wide range of model scales and NLU tasks. It matches the performance of finetuning while having only 0.1%-3% tuned parameters. Our method P-Tuning v2 is an implementation of Deep Prompt Tuning \cite{li2021prefix,qin2021learning} optimized and adapted for NLU. Given the universality and simplicity of P-Tuning v2, we believe it can serve as an alternative to finetuning and a strong baseline for future research.Our code and data are released at https://github.com/THUDM/P-tuning-v2.


title: Sub-word Level Lip Reading With Visual Attention

abstract: The goal of this paper is to learn strong lip reading models that can recognise speech in silent videos. Most prior works deal with the open-set visual speech recognition problem by adapting existing automatic speech recognition techniques on top of trivially pooled visual features. Instead, in this paper we focus on the unique challenges encountered in lip reading and propose tailored solutions. To this end, we make the following contributions: (1) we propose an attention-based pooling mechanism to aggregate visual speech representations; (2) we use sub-word units for lip reading for the first time and show that this allows us to better model the ambiguities of the task; (3) we propose a model for Visual Speech Detection (VSD), trained on top of the lip reading network. Following the above, we obtain state-of-the-art results on the challenging LRS2 and LRS3 benchmarks when training on public datasets, and even surpass models trained on large-scale industrial datasets by using an order of magnitude less data. Our best model achieves 22.6% word error rate on the LRS2 dataset, a performance unprecedented for lip reading models, significantly reducing the performance gap between lip reading and automatic speech recognition. Moreover, on the AVA-ActiveSpeaker benchmark, our VSD model surpasses all visual-only baselines and even outperforms several recent audio-visual methods.


title: NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wild

abstract: Recent history has seen a tremendous growth of work exploring implicit representations of geometry and radiance, popularized through Neural Radiance Fields (NeRF). Such works are fundamentally based on a (implicit) volumetric representation of occupancy, allowing them to model diverse scene structure including translucent objects and atmospheric obscurants. But because the vast majority of real-world scenes are composed of well-defined surfaces, we introduce a surface analog of such implicit models called Neural Reflectance Surfaces (NeRS). NeRS learns a neural shape representation of a closed surface that is diffeomorphic to a sphere, guaranteeing water-tight reconstructions. Even more importantly, surface parameterizations allow NeRS to learn (neural) bidirectional surface reflectance functions (BRDFs) that factorize view-dependent appearance into environmental illumination, diffuse color (albedo), and specular "shininess." Finally, rather than illustrating our results on synthetic scenes or controlled in-the-lab capture, we assemble a novel dataset of multi-view images from online marketplaces for selling goods. Such "in-the-wild" multi-view image sets pose a number of challenges, including a small number of views with unknown/rough camera estimates. We demonstrate that surface-based neural reconstructions enable learning from such data, outperforming volumetric neural rendering-based reconstructions. We hope that NeRS serves as a first step toward building scalable, high-quality libraries of real-world shape, materials, and illumination. The project page with code and video visualizations can be found at https://jasonyzhang.com/ners.


title: $\beta$-Carotene bioavailability and conversion efficiency are significantly affected by sex in rats. First observation suggesting a possible hormetic regulation of vitamin A metabolism in female rats

abstract: Scope: To study the effect of variation in dietary vitamin A (VA) content on its hepatic and intestinal metabolism. Methods and results: Adult female and male rats were fed with diets containing 400, 2300, or 9858 IU/kg VA for 31-33 weeks. VA concentrations were measured in plasma and liver. Bioavailability and intestinal conversion efficiency of $\beta$-carotene to VA were assessed by measuring postprandial plasma $\beta$-carotene and retinyl palmitate concentrations after force-feeding rats with $\beta$-carotene. Expression of genes involved in VA metabolism, together with concentrations of RBP4, BCO1 and SR-BI proteins, were measured in the intestine and liver of female rats. Plasma retinol concentrations were lower and hepatic free retinol concentrations were higher in females than in males. There was no effect of dietary VA content on $\beta$-carotene bioavailability and its conversion efficiency, but bioavailability was higher and conversion efficiency was lower in females than in males. The expression of most genes exhibited a U-shaped dose response curve depending on VA intake. Main conclusions: $\beta$-Carotene bioavailability and conversion efficiency to VA are affected by the sex of rats. Results of gene expression suggest a hormetic regulation of VA metabolism in female rats.


title: Energy equality for the isentropic compressible Navier-Stokes equations without upper bound of the density

abstract: In this paper, we are concerned with the minimal regularity of both the density and the velocity for the weak solutions keeping energy equality in the isentropic compressible Navier-Stokes equations. The energy equality criteria without upper bound of the density are established. Almost all previous corresponding results requires $\rho\in L^{\infty}(0,T;L^{\infty}(\mathbb{T}^{d}))$.


title: HumBugDB: A Large-scale Acoustic Mosquito Dataset

abstract: This paper presents the first large-scale multi-species dataset of acoustic recordings of mosquitoes tracked continuously in free flight. We present 20 hours of audio recordings that we have expertly labelled and tagged precisely in time. Significantly, 18 hours of recordings contain annotations from 36 different species. Mosquitoes are well-known carriers of diseases such as malaria, dengue and yellow fever. Collecting this dataset is motivated by the need to assist applications which utilise mosquito acoustics to conduct surveys to help predict outbreaks and inform intervention policy. The task of detecting mosquitoes from the sound of their wingbeats is challenging due to the difficulty in collecting recordings from realistic scenarios. To address this, as part of the HumBug project, we conducted global experiments to record mosquitoes ranging from those bred in culture cages to mosquitoes captured in the wild. Consequently, the audio recordings vary in signal-to-noise ratio and contain a broad range of indoor and outdoor background environments from Tanzania, Thailand, Kenya, the USA and the UK. In this paper we describe in detail how we collected, labelled and curated the data. The data is provided from a PostgreSQL database, which contains important metadata such as the capture method, age, feeding status and gender of the mosquitoes. Additionally, we provide code to extract features and train Bayesian convolutional neural networks for two key tasks: the identification of mosquitoes from their corresponding background environments, and the classification of detected mosquitoes into species. Our extensive dataset is both challenging to machine learning researchers focusing on acoustic identification, and critical to entomologists, geo-spatial modellers and other domain experts to understand mosquito behaviour, model their distribution, and manage the threat they pose to humans.


title: 3D Structure from 2D Microscopy images using Deep Learning

abstract: Understanding the structure of a protein complex is crucial indetermining its function. However, retrieving accurate 3D structures from microscopy images is highly challenging, particularly as many imaging modalities are two-dimensional. Recent advances in Artificial Intelligence have been applied to this problem, primarily using voxel based approaches to analyse sets of electron microscopy images. Herewe present a deep learning solution for reconstructing the protein com-plexes from a number of 2D single molecule localization microscopy images, with the solution being completely unconstrained. Our convolutional neural network coupled with a differentiable renderer predicts pose and derives a single structure. After training, the network is dis-carded, with the output of this method being a structural model which fits the data-set. We demonstrate the performance of our system on two protein complexes: CEP152 (which comprises part of the proximal toroid of the centriole) and centrioles.


title: Application of Sequence Embedding in Protein Sequence-Based Predictions

abstract: In sequence-based predictions, conventionally an input sequence is represented by a multiple sequence alignment (MSA) or a representation derived from MSA, such as a position-specific scoring matrix. Recently, inspired by the development in natural language processing, several applications of sequence embedding have been observed. Here, we review different approaches of protein sequence embeddings and their applications including protein contact prediction, secondary structure, prediction, and function prediction.


title: Non-contact Atrial Fibrillation Detection from Face Videos by Learning Systolic Peaks

abstract: Objective: We propose a non-contact approach for atrial fibrillation (AF) detection from face videos. Methods: Face videos, electrocardiography (ECG), and contact photoplethysmography (PPG) from 100 healthy subjects and 100 AF patients are recorded. Data recordings from healthy subjects are all labeled as healthy. Two cardiologists evaluated ECG recordings of patients and labeled each recording as AF, sinus rhythm (SR), or atrial flutter (AFL). We use the 3D convolutional neural network for remote PPG monitoring and propose a novel loss function (Wasserstein distance) to use the timing of systolic peaks from contact PPG as the label for our model training. Then a set of heart rate variability (HRV) features are calculated from the inter-beat intervals, and a support vector machine (SVM) classifier is trained with HRV features. Results: Our proposed method can accurately extract systolic peaks from face videos for AF detection. The proposed method is trained with subject-independent 10-fold cross-validation with 30s video clips and tested on two tasks. 1) Classification of healthy versus AF: the accuracy, sensitivity, and specificity are 96.00%, 95.36%, and 96.12%. 2) Classification of SR versus AF: the accuracy, sensitivity, and specificity are 95.23%, 98.53%, and 91.12%. In addition, we also demonstrate the feasibility of non-contact AFL detection. Conclusion: We achieve good performance of non-contact AF detection by learning systolic peaks. Significance: non-contact AF detection can be used for self-screening of AF symptoms for suspectable populations at home or self-monitoring of AF recurrence after treatment for chronic patients.


title: Locational Factors in the Competition between Credit Unions and Banks after the Great Recession

abstract: In the aftermath of the Great Recession, the regulatory framework for credit union operations has become a subject of controversy. Competing financial enterprises such as thrifts and other banks have argued that credit unions have received preferential treatment under existing tax and regulatory codes, whereas credit unions complained of undue restrictions on their ability to scale up and increase their scope of operations. Building on previous location models, this analysis focuses on credit union headquarter locations immediately following the 2008 financial crisis. We offer a new perspective for understanding credit union behavior based on central place theory, new industrial organization literature, and credit union location analysis. Our findings indicate that credit unions avoid locating near other lending institutions, instead operating in areas with a low concentration of other banks. This finding provides evidence that credit unions serve niche markets, product differential, and are not a significant source of direct competition for thrifts and other banks.