title: On finite groups with an automorphism of prime order whose fixed points have bounded Engel sinks

abstract: A left Engel sink of an element $g$ of a group $G$ is a set ${\mathscr E}(g)$ such that for every $x\in G$ all sufficiently long commutators $[...[[x,g],g],\dots ,g]$ belong to ${\mathscr E}(g)$. (Thus, $g$ is a left Engel element precisely when we can choose ${\mathscr E}(g)=\{ 1\}$.) We prove that if a finite group $G$ admits an automorphism $\varphi $ of prime order coprime to $|G|$ such that for some positive integer $m$ every element of the centralizer $C_G(\varphi )$ has a left Engel sink of cardinality at most $m$, then the index of the second Fitting subgroup $F_2(G)$ is bounded in terms of $m$. A right Engel sink of an element $g$ of a group $G$ is a set ${\mathscr R}(g)$ such that for every $x\in G$ all sufficiently long commutators $[...[[g,x],x],\dots ,x]$ belong to ${\mathscr R}(g)$. (Thus, $g$ is a right Engel element precisely when we can choose ${\mathscr R}(g)=\{ 1\}$.) We prove that if a finite group $G$ admits an automorphism $\varphi$ of prime order coprime to $|G|$ such that for some positive integer $m$ every element of the centralizer $C_G(\varphi )$ has a right Engel sink of cardinality at most $m$, then the index of the Fitting subgroup $F_1(G)$ is bounded in terms of $m$.


title: Ice Giant Atmospheric Science

abstract: This white paper, written in support of NASA's 2023-2032 Planetary Decadal Survey, outlines 10 major questions that focus on the origin, evolution, and current processes that shape the atmospheres of Uranus and Neptune. Prioritizing these questions over the next decade will greatly improve our understanding of this unique class of planets, which have remained largely unexplored since the Voyager flybys. Studying the atmospheres of the Ice Giants will greatly inform our understanding of the origin and evolution of the solar system as a whole, in addition to the growing number of exoplanetary systems that contain Neptune-mass planets.


title: Substance over Style: Document-Level Targeted Content Transfer

abstract: Existing language models excel at writing from scratch, but many real-world scenarios require rewriting an existing document to fit a set of constraints. Although sentence-level rewriting has been fairly well-studied, little work has addressed the challenge of rewriting an entire document coherently. In this work, we introduce the task of document-level targeted content transfer and address it in the recipe domain, with a recipe as the document and a dietary restriction (such as vegan or dairy-free) as the targeted constraint. We propose a novel model for this task based on the generative pre-trained language model (GPT-2) and train on a large number of roughly-aligned recipe pairs (https://github.com/microsoft/document-level-targeted-content-transfer). Both automatic and human evaluations show that our model out-performs existing methods by generating coherent and diverse rewrites that obey the constraint while remaining close to the original document. Finally, we analyze our model's rewrites to assess progress toward the goal of making language generation more attuned to constraints that are substantive rather than stylistic.


title: Complex Monge-Ampere equations with solutions in finite energy classes

abstract: We characterize the class of probability measures on a compact Kahler manifold such that the associated Monge-Amp\`ere equation has a solution of finite pluricomplex energy. Our results are also valid in the big cohomology class setting.


title: Sliding-Window QPS (SW-QPS): A Perfect Parallel Iterative Switching Algorithm for Input-Queued Switches

abstract: In this work, we first propose a parallel batch switching algorithm called Small-Batch Queue-Proportional Sampling (SB-QPS). Compared to other batch switching algorithms, SB-QPS significantly reduces the batch size without sacrificing the throughput performance and hence has much lower delay when traffic load is light to moderate. It also achieves the lowest possible time complexity of $O(1)$ per matching computation per port, via parallelization. We then propose another algorithm called Sliding-Window QPS (SW-QPS). SW-QPS retains and enhances all benefits of SB-QPS, and reduces the batching delay to zero via a novel switching framework called sliding-window switching. In addition, SW-QPS computes matchings of much higher qualities, as measured by the resulting throughput and delay performances, than QPS-1, the state-of-the-art regular switching algorithm that builds upon the same underlying bipartite matching algorithm.


title: Insights on magnon topology and valley-polarization in 2D bilayer quantum magnets

abstract: The rich and unconventional physics in layered 2D magnets can open new avenues for topological magnonics and magnon valleytronics. In particular, two-dimensional (2D) bilayer quantum magnets are gaining increasing attention due to their intriguing stacking-dependent magnetism, controllable ground states, and topological excitations induced by magnetic spin-orbit couplings (SOCs). Despite the substantial research on these materials, their topological features remain widely unexplored to date. The present study comprehensively investigates the magnon topology and magnon valley-polarization in honeycomb bilayers with collinear magnetic order. We elucidate the separate and combined effects of the SOC, magnetic ground-states, stacking order, and inversion symmetry breaking on the topological phases, magnon valley transport, and the Hall and Nernst effects. The comprehensive analysis suggests clues to determine the SOC's nature and predicts unconventional Hall and Nernst conductivities in topologically trivial phases. We further report on novel bandgap closures in layered antiferromagnets and detail their topological implications. We believe the present study provides important insights into the fundamental physics and technological potentials of topological 2D magnons.


title: LiMITS: An Effective Approach for Trajectory Simplification

abstract: Trajectories represent the mobility of moving objects and thus is of great value in data mining applications. However, trajectory data is enormous in volume, so it is expensive to store and process the raw data directly. Trajectories are also redundant so data compression techniques can be applied. In this paper, we propose effective algorithms to simplify trajectories. We first extend existing algorithms by replacing the commonly used $L_2$ metric with the $L_\infty$ metric so that they can be generalized to high dimensional space (e.g., 3-space in practice). Next, we propose a novel approach, namely L-infinity Multidimensional Interpolation Trajectory Simplification (LiMITS). LiMITS belongs to weak simplification and takes advantage of the $L_\infty$ metric. It generates simplified trajectories by multidimensional interpolation. It also allows a new format called compact representation to further improve the compression ratio. Finally, We demonstrate the performance of LiMITS through experiments on real-world datasets, which show that it is more effective than other existing methods.


title: Quartic surface, its bitangents and rational points

abstract: Let X be a smooth quartic surface not containing lines, defined over a number field K. We prove that there are only finitely many bitangents to X which are defined over K. This result can be interpreted as saying that a certain surface, having vanishing irregularity, contains only finitely many rational points. In our proof, we use the geometry of lines of the quartic double solid associated to X. In a somewhat opposite direction, we show that on any quartic surface X over a number field K, the set of algebraic points in X(\overeline K) which are quadratic over a suitable finite extension K' of K is Zariski-dense.


title: An updated detailed characterization of planes of satellites in the MW and M31

abstract: We present a detailed characterization of planes of satellite galaxies in the Milky Way (MW) and M31. For a positional analysis, we introduce an extension to the `4-galaxy-normal density plot' method \citep[][P13]{Pawlowski13}. It finds the normal directions to the predominant planar configurations of satellites of a system, yielding for each a \textit{collection} of planes of increasing member satellites. This allows to quantify the quality of planes in terms of population ($N_{\rm sat}$) and spatial flattening ($c/a$). We apply this method to the latest data for confirmed MW and M31 satellite samples, with 46 and 34 satellites, respectively. New MW satellites form part of planes previously identified from the sample with $N_{\rm sat}=27$ studied in P13: we identify a new plane with $N_{\rm sat}=39$ as thin as the VPOS-3 ($c/a\sim 0.2$), and with roughly the same normal direction; so far the most populated plane that thin reported in the Local Group. We introduce a new method to determine, using kinematic data, the axis of maximum co-orbitation of MW satellites. Interestingly, this axis approximately coincides with the normal to the former plane: $\geq45\pm5\%$ of satellites co-orbit. In M31 we discover a plane with $N_{\rm sat}=18$ and $c/a\sim0.15$, i.e., quality comparable to the GPoA, and perpendicular to it. This structure is viewed face-on from the Sun making it susceptible to M31 satellite distance uncertainties. An estimation of the perpendicular velocity dispersion suggests it is dynamically unstable. Finally we find that mass is not a property determining a satellite's membership to good quality planes.


title: A case where a spindly two-layer linear network whips any neural network with a fully connected input layer

abstract: It was conjectured that any neural network of any structure and arbitrary differentiable transfer functions at the nodes cannot learn the following problem sample efficiently when trained with gradient descent: The instances are the rows of a $d$-dimensional Hadamard matrix and the target is one of the features, i.e. very sparse. We essentially prove this conjecture: We show that after receiving a random training set of size $k < d$, the expected square loss is still $1-\frac{k}{(d-1)}$. The only requirement needed is that the input layer is fully connected and the initial weight vectors of the input nodes are chosen from a rotation invariant distribution. Surprisingly the same type of problem can be solved drastically more efficient by a simple 2-layer linear neural network in which the $d$ inputs are connected to the output node by chains of length 2 (Now the input layer has only one edge per input). When such a network is trained by gradient descent, then it has been shown that its expected square loss is $\frac{\log d}{k}$. Our lower bounds essentially show that a sparse input layer is needed to sample efficiently learn sparse targets with gradient descent when the number of examples is less than the number of input features.


title: Quantum-Inspired Classical Algorithm for Principal Component Regression

abstract: This paper presents a sublinear classical algorithm for principal component regression. The algorithm uses quantum-inspired linear algebra, an idea developed by Tang. Using this technique, her algorithm for recommendation systems achieved runtime only polynomially slower than its quantum counterpart. Her work was quickly adapted to solve many other problems in sublinear time complexity. In this work, we developed an algorithm for principal component regression that runs in time polylogarithmic to the number of data points, an exponential speed up over the state-of-the-art algorithm, under the mild assumption that the input is given in some data structure that supports a norm-based sampling procedure. This exponential speed up allows for potential applications in much larger data sets.


title: Minimax Quasi-Bayesian estimation in sparse canonical correlation analysis via a Rayleigh quotient function

abstract: Canonical correlation analysis (CCA) is a popular statistical technique for exploring relationships between datasets. In recent years, the estimation of sparse canonical vectors has emerged as an important but challenging variant of the CCA problem, with widespread applications. Unfortunately, existing rate-optimal estimators for sparse canonical vectors have high computational cost. We propose a quasi-Bayesian estimation procedure that not only achieves the minimax estimation rate, but also is easy to compute by Markov Chain Monte Carlo (MCMC). The method builds on Tan et al. (2018) and uses a re-scaled Rayleigh quotient function as the quasi-log-likelihood. However, unlike Tan et al. (2018), we adopt a Bayesian framework that combines this quasi-log-likelihood with a spike-and-slab prior to regularize the inference and promote sparsity. We investigate the empirical behavior of the proposed method on both continuous and truncated data, and we demonstrate that it outperforms several state-of-the-art methods. As an application, we use the proposed methodology to maximally correlate clinical variables and proteomic data for better understanding the Covid-19 disease.


title: Evaluation of a meta-analysis of ambient air quality as a risk factor for asthma exacerbation

abstract: False-positive results and bias may be common features of the biomedical literature today, including risk factor-chronic disease research. A study was undertaken to assess the reliability of base studies used in a meta-analysis examining whether carbon monoxide, particulate matter 10 and 2.5 micro molar, sulfur dioxide, nitrogen dioxide and ozone are risk factors for asthma exacerbation (hospital admission and emergency room visits for asthma attack). The number of statistical tests and models were counted in 17 randomly selected base papers from 87 used in the meta-analysis. P-value plots for each air component were constructed to evaluate the effect heterogeneity of p-values used from all 87 base papers The number of statistical tests possible in the 17 selected base papers was large, median=15,360 (interquartile range=1,536 to 40,960), in comparison to results presented. Each p-value plot showed a two-component mixture with small p-values less than .001 while other p-values appeared random (p-values greater than .05). Given potentially large numbers of statistical tests conducted in the 17 selected base papers, p-hacking cannot be ruled out as explanations for small p-values. Our interpretation of the meta-analysis is that the random p-values indicating null associations are more plausible and that the meta-analysis will not likely replicate in the absence of bias. We conclude the meta-analysis and base papers used are unreliable and do not offer evidence of value to inform public health practitioners about air quality as a risk factor for asthma exacerbation. The following areas are crucial for enabling improvements in risk factor chronic disease observational studies at the funding agency and journal level: preregistration, changes in funding agency and journal editor (and reviewer) practices, open sharing of data and facilitation of reproducibility research.


title: The Squeezed OTOC and Cosmology

abstract: Exponential growth in the out-of-time-order correlator (OTOC) is an important potential signature of quantum chaos. The OTOC is quite simple to calculate for squeezed states, whose applications are frequently found in quantum optics and cosmology. We find that the OTOC for a generic highly squeezed quantum state is exponentially large, suggesting that highly squeezed states are "primed" for quantum chaos. A quantum generalization of the classical symplectic phase space matrix can be used to extract the quantum Lyapunov spectrum, and we find this better captures the exponential growth of squeezed states for all squeezing angles compared to any single OTOC. By describing cosmological perturbations in the squeezed state language, we are able to apply our calculations of the OTOC to arbitrary expanding and contracting backgrounds with fixed equation of state. We find that only expanding de Sitter backgrounds support an exponentially growing OTOC at late times, with a putative Lyapunov exponent consistent with other calculations. While the late-time behavior of the OTOC for other cosmological backgrounds appears to change depending on the equation of state, we find that the quantum Lyapunov spectrum shows some universal behavior: the OTOC grows proportional to the scale factor for perturbation wavelengths larger than the cosmological Hubble horizon.


title: Adaptive Gradient Search Beamforming for Full-Duplex mmWave MIMO Systems

abstract: In this work, we present a framework analysis of full-duplex (FD) systems for Millimeter Wave (mmWave) analog architecture. Given that FD systems can double the ergodic capacity, such systems experience large losses caused by the loopback self-interference (SI). In addition, systems with analog architecture also suffer from other forms of losses mainly incurred by the constant amplitude (CA) constraint. For this purpose, we propose the projected Gradient Ascent algorithm to maximize the sum rate under the unit-norm and CA constraints. Unlike previous works, our approach achieves the best spectral efficiency while minimizing the losses incurred by the CA constraint. We also consider an adaptive step size to compensate for the perturbations that may affect the cost function during the optimization. The results will show that the proposed algorithm converges to the same optimal value for different initializations while the number of iterations required for the convergence changes for each case. In this context, we primarily consider the gradient search method for a two-nodes FD systems and then we extend the analysis for a dual-hop FD relaying systems. Finally, we evaluate the robustness of our method in terms of rate and outage probability and compare with previous approaches.


title: The Large Core of College Admission Markets: Theory and Evidence

abstract: We study stable allocations in college admissions markets where students can attend the same college under different financial terms. The deferred acceptance algorithm identifies a stable allocation where funding is allocated based on merit. While merit-based stable allocations assign the same students to college, non-merit-based stable allocations may differ in the number of students assigned to college. In large markets, this possibility requires heterogeneity in applicants' sensitivity to financial terms. In Hungary, where such heterogeneity is present, a non-merit-based stable allocation would increase the number of assigned applicants by 1.9%, and affect 8.3% of the applicants relative to any merit-based stable allocation. These findings contrast sharply with findings from the matching (without contracts) literature.


title: Optimality of function spaces for kernel integral operators

abstract: We explore boundedness properties of kernel integral operators acting on rearrangement-invariant (r.i.) spaces. In particular, for a given r.i. space $X$ we characterize its optimal range partner, that is, the smallest r.i. space $Y$ such that the operator is bounded from $X$ to $Y$. We apply the general results to Lorentz spaces to illustrate their strength.


title: Universal guarantees for decision tree induction via a higher-order splitting criterion

abstract: We propose a simple extension of top-down decision tree learning heuristics such as ID3, C4.5, and CART. Our algorithm achieves provable guarantees for all target functions $f: \{-1,1\}^n \to \{-1,1\}$ with respect to the uniform distribution, circumventing impossibility results showing that existing heuristics fare poorly even for simple target functions. The crux of our extension is a new splitting criterion that takes into account the correlations between $f$ and small subsets of its attributes. The splitting criteria of existing heuristics (e.g. Gini impurity and information gain), in contrast, are based solely on the correlations between $f$ and its individual attributes. Our algorithm satisfies the following guarantee: for all target functions $f : \{-1,1\}^n \to \{-1,1\}$, sizes $s\in \mathbb{N}$, and error parameters $\epsilon$, it constructs a decision tree of size $s^{\tilde{O}((\log s)^2/\epsilon^2)}$ that achieves error $\le O(\mathsf{opt}_s) + \epsilon$, where $\mathsf{opt}_s$ denotes the error of the optimal size $s$ decision tree. A key technical notion that drives our analysis is the noise stability of $f$, a well-studied smoothness measure.


title: Casimir microcavities for tunable self-assembled polaritons

abstract: Hybrid light-matter states, polaritons, are one of the central concepts in modern quantum optics and condensed matter physics. Polaritons emerge as a result of strong interaction between an optical mode and a material resonance, which is frequently realized in molecular, van der Waals, or solid-state platforms (1-7). However, this route requires accurate (nano)fabrication and often lacks simple means for tunability, which could be disadvantageous in some applications. Here, we use a different approach to realize polaritonic states by employing a stable equilibrium between two parallel gold nanoflakes in an aqueous solution (8). Such plates form a self-assembled Fabry-Perot microcavity with the fundamental optical mode in the visible spectral range. The equilibrium distance between the plates is determined by a balance between attractive Casimir and repulsive electrostatic forces (9-11) and can be controlled by concentration of ligand molecules in the solution, temperature, and light pressure, which allows active and facile tuning of the cavity resonance by external stimuli. Using this Casimir approach, we demonstrate self-assembled polaritons by placing an excitonic medium in the microcavity region, as well as observe their laser-induced modulations in and out of the strong coupling regime. These Casimir microcavities can be used as sensitive and tunable polaritonic platforms for a variety of applications, including opto-mechanics (12), nanomachinery (13), and cavity-induced effects, like polaritonic chemistry (14).


title: Adaptive network approach for emergence of societal bubbles

abstract: Far beyond its relevance for commercial and political marketings, opinion formation and decision making processes are central for representative democracy, government functioning, and state organization. In the present report, a stochastic agent-based model is investigated. The model assumes that bounded confidence and homophily mechanisms drive both opinion dynamics and social network evolution through either rewiring or breakage of social contacts. In addition to the classical transition from global consensus to opinion polarization, our main findings are (i) a cascade of fragmentation of the social network into echo chambers (modules) holding distinct opinions and rupture of the bridges interconnecting these modules as the tolerance for opinion differences increases. There are multiple surviving opinions associated to these modules within which consensus is formed; and (ii) the adaptive social network exhibits a hysteresis-like behavior characterized by irreversible changes in its topology as the opinion tolerance cycles from radicalization towards consensus and backward to radicalization.


title: Hyperfine Couplings as a Probe of Orbital Anisotropy in Heavy Fermion Materials

abstract: The transferred hyperfine interaction between nuclear and electron spins in an heavy fermion material depends on the hybridization between the $f$-electron orbitals and those surrounding a distant nucleus. In CeMIn$_5$ (M=Rh, Ir, Co), both the hyperfine coupling to the two indium sites as well as the crystalline electric field at the Ce are strongly dependent on the transition metal. We measure a series of CeRh$_{1-x}$Ir$_x$In$_5$ crystals and find that the hyperfine coupling reflects the orbital anisotropy of the ground state Ce 4$f$ wavefunction. These findings provide direct proof that the localized to itinerant transition is dominated by hybridization out of the Ce-In plane in this system.


title: Proportional Representation under Single-Crossing Preferences Revisited

abstract: We study the complexity of determining a winning committee under the Chamberlin--Courant voting rule when voters' preferences are single-crossing on a line, or, more generally, on a median graph (this class of graphs includes, e.g., trees and grids). For the line, Skowron et al. (2015) describe an $O(n^2mk)$ algorithm (where $n$, $m$, $k$ are the number of voters, the number of candidates and the committee size, respectively); we show that a simple tweak improves the time complexity to $O(nmk)$. We then improve this bound for $k=\Omega(\log n)$ by reducing our problem to the $k$-link path problem for DAGs with concave Monge weights, obtaining a $nm2^{O\left(\sqrt{\log k\log\log n}\right)}$ algorithm for the general case and a nearly linear algorithm for the Borda misrepresentation function. For trees, we point out an issue with the algorithm proposed by Clearwater, Puppe and Slinko (2015), and develop a $O(nmk)$ algorithm for this case as well. For grids, we formulate a conjecture about the structure of optimal solutions, and describe a polynomial-time algorithm that finds a winning committee if this conjecture is true; we also explain how to convert this algorithm into a bicriterial approximation algorithm whose correctness does not depend on the conjecture.


title: Detailed studies of IPHAS sources -- I. The disrupted late bipolar IPHASX J193718.6+202102

abstract: We present a detailed analysis of the new planetary nebula (PN) IPHASX J193718.6+202102 using deep imaging and intermediate- and high resolution spectroscopy that are interpreted through morpho-kinematic and photoionisation modelling. The physical structure of the nebula consists of a fragmented torus and an extremely faint orthogonal bipolar outflow, contrary to the pinched waist PN morphology suggested by its optical image. Our kinematic analysis indicates that the torus is expanding at 25$\pm$5 km s$^{-1}$ and is gradually breaking up. At an estimated distance of 7.1$_{-0.3}^{+0.8}$ kpc, the corresponding kinematic age of $\sim$26000 years is consistent with a faint and disintegrating PN. The intermediate-resolution spectra reveal an excited PN with chemical abundances typical of Type II PNe. Based on the latter we also estimate an initial mass for the progenitor in the range 2--3 M$_{\odot}$ and a central star (CSPN) mass $M_\mathrm{CSPN}\sim$0.61 M$_{\odot}$. The Spitzer MIPS 24 $\mu$m emission that closely follows the fragmented torus could be attributed to the emission of [O IV] at 25.9 $\mu$m rather than to dust emission. All the results coherently point towards an evolved moderately massive bipolar Type II PN on the brink of dissolving into the interstellar medium.


title: A general approach to compute the relevance of middle-level input features

abstract: This work proposes a novel general framework, in the context of eXplainable Artificial Intelligence (XAI), to construct explanations for the behaviour of Machine Learning (ML) models in terms of middle-level features. One can isolate two different ways to provide explanations in the context of XAI: low and middle-level explanations. Middle-level explanations have been introduced for alleviating some deficiencies of low-level explanations such as, in the context of image classification, the fact that human users are left with a significant interpretive burden: starting from low-level explanations, one has to identify properties of the overall input that are perceptually salient for the human visual system. However, a general approach to correctly evaluate the elements of middle-level explanations with respect ML model responses has never been proposed in the literature.


title: GFB-MRF: A parallel spatial and Bloch manifold regularized iterative reconstruction method for MR Fingerprinting

abstract: Magnetic Resonance Fingerprinting (MRF) reconstructs tissue maps based on a sequence of very highly undersampled images. In order to be able to perform MRF reconstruction, state-of-the-art MRF methods rely on priors such as the MR physics (Bloch equations) and might also use some additional low-rank or spatial regularization. However to our knowledge these three regularizations are not applied together in a joint reconstruction. The reason is that it is indeed challenging to incorporate effectively multiple regularizations in a single MRF optimization algorithm. As a result most of these methods are not robust to noise especially when the sequence length is short. In this paper, we propose a family of new methods where spatial and low-rank regularizations, in addition to the Bloch manifold regularization, are applied on the images. We show on digital phantom and NIST phantom scans, as well as volunteer scans that the proposed methods bring significant improvement in the quality of the estimated tissue maps.


title: Deep Neural Dynamic Bayesian Networks applied to EEG sleep spindles modeling

abstract: We propose a generative model for single-channel EEG that incorporates the constraints experts actively enforce during visual scoring. The framework takes the form of a dynamic Bayesian network with depth in both the latent variables and the observation likelihoods-while the hidden variables control the durations, state transitions, and robustness, the observation architectures parameterize Normal-Gamma distributions. The resulting model allows for time series segmentation into local, reoccurring dynamical regimes by exploiting probabilistic models and deep learning. Unlike typical detectors, our model takes the raw data (up to resampling) without pre-processing (e.g., filtering, windowing, thresholding) or post-processing (e.g., event merging). This not only makes the model appealing to real-time applications, but it also yields interpretable hyperparameters that are analogous to known clinical criteria. We derive algorithms for exact, tractable inference as a special case of Generalized Expectation Maximization via dynamic programming and backpropagation. We validate the model on three public datasets and provide support that more complex models are able to surpass state-of-the-art detectors while being transparent, auditable, and generalizable.


title: Multimodal Speech Recognition with Unstructured Audio Masking

abstract: Visual context has been shown to be useful for automatic speech recognition (ASR) systems when the speech signal is noisy or corrupted. Previous work, however, has only demonstrated the utility of visual context in an unrealistic setting, where a fixed set of words are systematically masked in the audio. In this paper, we simulate a more realistic masking scenario during model training, called RandWordMask, where the masking can occur for any word segment. Our experiments on the Flickr 8K Audio Captions Corpus show that multimodal ASR can generalize to recover different types of masked words in this unstructured masking setting. Moreover, our analysis shows that our models are capable of attending to the visual signal when the audio signal is corrupted. These results show that multimodal ASR systems can leverage the visual signal in more generalized noisy scenarios.


title: On the Origin of Optical Radiation During the Impulsive Phase of Flares on dMe Stars. II. Continuum and Line Radiation

abstract: It is argued that not only the blue (at the brightness maximum) but also the red (in the slow decay phase) components of the optical continuum of powerful flares on dMe stars are formed near the photosphere. The possible appearance of HeI lines in the relaxation zones for the plasma to a state of thermal equilibrium (as a result of a rise in electron temperature owing to elastic collisions of electrons with atoms and ions) is noted (for sufficiently high speeds of a non-stationary chromospheric shock wave propagating toward the photosphere of the Sun and stars). A scheme is proposed for the positioning of the "layers" of plasma responsible for the generation of radiation in the white light continuum during the impulsive phase of powerful stellar flares.


title: Zoom-CAM: Generating Fine-grained Pixel Annotations from Image Labels

abstract: Current weakly supervised object localization and segmentation rely on class-discriminative visualization techniques to generate pseudo-labels for pixel-level training. Such visualization methods, including class activation mapping (CAM) and Grad-CAM, use only the deepest, lowest resolution convolutional layer, missing all information in intermediate layers. We propose Zoom-CAM: going beyond the last lowest resolution layer by integrating the importance maps over all activations in intermediate layers. Zoom-CAM captures fine-grained small-scale objects for various discriminative class instances, which are commonly missed by the baseline visualization methods. We focus on generating pixel-level pseudo-labels from class labels. The quality of our pseudo-labels evaluated on the ImageNet localization task exhibits more than 2.8% improvement on top-1 error. For weakly supervised semantic segmentation our generated pseudo-labels improve a state of the art model by 1.1%.


title: Pairwise Compatibility for 2-Simple Minded Collections II: Preprojective Algebras and Semibrick Pairs of Full Rank

abstract: Let $\Lambda$ be a finite-dimensional associative algebra over a field. A semibrick pair is a finite set of $\Lambda$-modules for which certain Hom- and Ext-sets vanish. A semibrick pair is completable if it can be enlarged so that a generating condition is satisfied. We prove that if $\Lambda$ is $\tau$-tilting finite with at most 3 simple modules, then the completability of a semibrick pair can be characterized using conditions on pairs of modules. We then use the weak order to construct a combinatorial model for the semibrick pairs of preprojective algebras of type $A_n$. From this model, we deduce that any semibrick pair of size $n$ satisfies the generating condition, and that the dimension vectors of any semibrick pair form a subset of the column vectors of some $c$-matrix. Finally, we show that no "pairwise" criteria for completability exists for preprojective algebras of Dynkin diagrams with more than 3 vertices.


title: Generalizations of Alder's Conjecture via a Conjecture of Kang and Park

abstract: Integer partitions have long been of interest to number theorists, perhaps most notably Ramanujan, and are related to many areas of mathematics including combinatorics, modular forms, representation theory, analysis, and mathematical physics. Here, we focus on partitions with gap conditions and partitions with parts coming from fixed residue classes. Let $\Delta_d^{(a,b)}(n) = q_d^{(a)}(n) - Q_d^{(b)}(n)$ where $q_d^{(a)}(n)$ counts the number of partitions of $n$ into parts with difference at least $d$ and size at least $a$, and $Q_d^{(b)}(n)$ counts the number of partitions into parts $\equiv \pm b \pmod{d + 3}$. In 1956, Alder conjectured that $\Delta_d^{(1,1)}(n) \geq 0$ for all positive $n$ and $d$. This conjecture was proved partially by Andrews in 1971, by Yee in 2008, and was fully resolved by Alfes, Jameson and Lemke Oliver in 2011. Alder's conjecture generalizes several well-known partition identities, including Euler's theorem that the number of partitions of $n$ into odd parts equals the number of partitions of $n$ into distinct parts, as well as the first of the famous Rogers-Ramanujan identities. In 2020, Kang and Park constructed an extension of Alder's conjecture which relates to the second Rogers-Ramanujan identity by considering $\Delta_d^{(a,b,-)}(n) = q_d^{(a)}(n) - Q_d^{(b,-)}(n)$ where $Q_d^{(b,-)}(n)$ counts the number of partitions into parts $\equiv \pm b \pmod{d + 3}$ excluding the $d+3-b$ part. Kang and Park conjectured that $\Delta_d^{(2,2,-)}(n)\geq 0$ for all $d\geq 1$ and $n\geq 0$, and proved this for $d = 2^r - 2$ and $n$ even. We prove Kang and Park's conjecture for all but finitely many $d$. Toward proving the remaining cases, we adapt work of Alfes, Jameson and Lemke Oliver to generate asymptotics for the related functions. Finally, we present a more generalized conjecture for higher $a=b$ and prove it for infinite classes of $n$ and $d$.


title: The fixed point property for $(c)$-mappings and unbounded sets

abstract: We prove that a closed convex subset $C$ of a real Hilbert space $X$ has the fixed point property for $(c)$-mappings if and only if $C$ is bounded. Some convergence results about the iterations are obtained.


title: Ensembling Low Precision Models for Binary Biomedical Image Segmentation

abstract: Segmentation of anatomical regions of interest such as vessels or small lesions in medical images is still a difficult problem that is often tackled with manual input by an expert. One of the major challenges for this task is that the appearance of foreground (positive) regions can be similar to background (negative) regions. As a result, many automatic segmentation algorithms tend to exhibit asymmetric errors, typically producing more false positives than false negatives. In this paper, we aim to leverage this asymmetry and train a diverse ensemble of models with very high recall, while sacrificing their precision. Our core idea is straightforward: A diverse ensemble of low precision and high recall models are likely to make different false positive errors (classifying background as foreground in different parts of the image), but the true positives will tend to be consistent. Thus, in aggregate the false positive errors will cancel out, yielding high performance for the ensemble. Our strategy is general and can be applied with any segmentation model. In three different applications (carotid artery segmentation in a neck CT angiography, myocardium segmentation in a cardiovascular MRI and multiple sclerosis lesion segmentation in a brain MRI), we show how the proposed approach can significantly boost the performance of a baseline segmentation method.


title: Numerical modeling of cosmic rays in the heliosphere: Analysis of proton data from AMS-02 and PAMELA

abstract: Galactic cosmic rays (CRs) inside the heliosphere are affected by solar modulation. To investigate this phenomenon and its underlying physical mechanisms, we have performed a data-driven analysis of the temporal dependence of the CR proton flux over the solar cycle. The modulation effect was modeled by means of stochastic simulations of cosmic particles in the heliosphere. The model were constrained using measurements of CR protons made by AMS-02 and PAMELA experiments on monthly basis from 2006 to 2017. With a global statistical analysis of these data, we have determined the key model parameters governing CR diffusion, its dependence on the particle rigidity, and its evolution over the solar cycle. Our results span over epochs of solar minimum, solar maximum, as well as epochs with magnetic reversal and opposite polarities. Along with the evolution of the CR transport parameters, we study their relationship with solar activity proxies and interplanetary parameters. We find that the rigidity dependence of the parallel mean free path of CR diffusion shows a remarkable time dependence, indicating a long-term variability in the interplanetary turbulence that interchanges across different regimes over the solar cycle. The evolution of the diffusion parameters show a delayed correlation with solar activity proxies, reflecting the dynamics of the heliospheric plasma, and distinct dependencies for opposite states of magnetic polarity, reflecting the influence of charge-sign dependent drift in the CR modulation.

categories: astro-ph.HE astro-ph.SR hep-ph physics.space-ph


title: Quasinormal Coupled Mode Theory

abstract: Coupled mode theory (CMT) is a powerful framework for decomposing interactions between electromagnetic waves and scattering bodies into resonances and their couplings with power-carrying channels. It has widespread use in few-resonance, weakly coupled resonator systems across nanophotonics, but cannot be applied to the complex scatterers of emerging importance. We use quasinormal modes to develop an exact, ab initio generalized coupled mode theory from Maxwell's equations. This quasinormal coupled mode theory, which we denote "QCMT", enables a direct, mode-based construction of scattering matrices without resorting to external solvers or data. We consider canonical scattering bodies, for which we show that a CMT model will necessarily be highly inaccurate, whereas QCMT exhibits near-perfect accuracy.


title: Reinforcement Learning for Efficient and Tuning-Free Link Adaptation

abstract: Wireless links adapt the data transmission parameters to the dynamic channel state -- this is called link adaptation. Classical link adaptation relies on tuning parameters that are challenging to configure for optimal link performance. Recently, reinforcement learning has been proposed to automate link adaptation, where the transmission parameters are modeled as discrete arms of a multi-armed bandit. In this context, we propose a latent learning model for link adaptation that exploits the correlation between data transmission parameters. Further, motivated by the recent success of Thompson sampling for multi-armed bandit problems, we propose a latent Thompson sampling (LTS) algorithm that quickly learns the optimal parameters for a given channel state. We extend LTS to fading wireless channels through a tuning-free mechanism that automatically tracks the channel dynamics. In numerical evaluations with fading wireless channels, LTS improves the link throughout by up to 100% compared to the state-of-the-art link adaptation algorithms.


title: Cross-Lingual Relation Extraction with Transformers

abstract: Relation extraction (RE) is one of the most important tasks in information extraction, as it provides essential information for many NLP applications. In this paper, we propose a cross-lingual RE approach that does not require any human annotation in a target language or any cross-lingual resources. Building upon unsupervised cross-lingual representation learning frameworks, we develop several deep Transformer based RE models with a novel encoding scheme that can effectively encode both entity location and entity type information. Our RE models, when trained with English data, outperform several deep neural network based English RE models. More importantly, our models can be applied to perform zero-shot cross-lingual RE, achieving the state-of-the-art cross-lingual RE performance on two datasets (68-89% of the accuracy of the supervised target-language RE model). The high cross-lingual transfer efficiency without requiring additional training data or cross-lingual resources shows that our RE models are especially useful for low-resource languages.


title: A Convolutional Neural Network for Multiple Particle Identification in the MicroBooNE Liquid Argon Time Projection Chamber

abstract: We present the multiple particle identification (MPID) network, a convolutional neural network (CNN) for multiple object classification, developed by MicroBooNE. MPID provides the probabilities of $e^-$, $\gamma$, $\mu^-$, $\pi^\pm$, and protons in a single liquid argon time projection chamber (LArTPC) readout plane. The network extends the single particle identification network previously developed by MicroBooNE. MPID takes as input an image either cropped around a reconstructed interaction vertex or containing only activity connected to a reconstructed vertex, therefore relieving the tool from inefficiencies in vertex finding and particle clustering. The network serves as an important component in MicroBooNE's deep learning based $\nu_e$ search analysis. In this paper, we present the network's design, training, and performance on simulation and data from the MicroBooNE detector.


title: Detection of CH$_3$C$_3$N in Titan's Atmosphere

abstract: Titan harbors a dense, organic-rich atmosphere primarily composed of N$_2$ and CH$_4$, with lesser amounts of hydrocarbons and nitrogen-bearing species. As a result of high sensitivity observations by the Atacama Large Millimeter/submillimeter Array (ALMA) in Band 6 ($\sim$230-272 GHz), we obtained the first spectroscopic detection of CH$_3$C$_3$N (methylcyanoacetylene or cyanopropyne) in Titan's atmosphere through the observation of seven transitions in the $J = 64\rightarrow63$ and $J = 62\rightarrow61$ rotational bands. The presence of CH$_3$C$_3$N on Titan was suggested by the Cassini Ion and Neutral Mass Spectrometer detection of its protonated form: C$_4$H$_3$NH$^+$, but the atmospheric abundance of the associated (deprotonated) neutral product is not well constrained due to the lack of appropriate laboratory reaction data. Here, we derive the column density of CH$_3$C$_3$N to be (3.8-5.7)$\times10^{12}$ cm$^{-2}$ based on radiative transfer models sensitive to altitudes above 400 km Titan's middle atmosphere. When compared with laboratory and photochemical model results, the detection of methylcyanoacetylene provides important constraints for the determination of the associated production pathways (such as those involving CN, CCN, and hydrocarbons), and reaction rate coefficients. These results also further demonstrate the importance of ALMA and (sub)millimeter spectroscopy for future investigations of Titan's organic inventory and atmospheric chemistry, as CH$_3$C$_3$N marks the heaviest polar molecule detected spectroscopically in Titan's atmosphere to date.


title: Adaptive Dense-to-Sparse Paradigm for Pruning Online Recommendation System with Non-Stationary Data

abstract: Large scale deep learning provides a tremendous opportunity to improve the quality of content recommendation systems by employing both wider and deeper models, but this comes at great infrastructural cost and carbon footprint in modern data centers. Pruning is an effective technique that reduces both memory and compute demand for model inference. However, pruning for online recommendation systems is challenging due to the continuous data distribution shift (a.k.a non-stationary data). Although incremental training on the full model is able to adapt to the non-stationary data, directly applying it on the pruned model leads to accuracy loss. This is because the sparsity pattern after pruning requires adjustment to learn new patterns. To the best of our knowledge, this is the first work to provide in-depth analysis and discussion of applying pruning to online recommendation systems with non-stationary data distribution. Overall, this work makes the following contributions: 1) We present an adaptive dense to sparse paradigm equipped with a novel pruning algorithm for pruning a large scale recommendation system with non-stationary data distribution; 2) We design the pruning algorithm to automatically learn the sparsity across layers to avoid repeating hand-tuning, which is critical for pruning the heterogeneous architectures of recommendation systems trained with non-stationary data.


title: Interaction of near-inertial waves with an anticyclonic vortex

abstract: Anticyclonic vortices focus and trap near-inertial waves so that near-inertial energy levels are elevated within the vortex core. Some aspects of this process, including the nonlinear modification of the vortex by the wave, are explained by the existence of trapped near-inertial eigenmodes. These vortex eigenmodes are easily excited by an initial wave with horizontal scale much larger than that of the vortex radius. We study this process using a wave-averaged model of near-inertial dynamics and compare its theoretical predictions with numerical solutions of the three-dimensional Boussinesq equations. In the linear approximation, the model predicts the eigenmode frequencies and spatial structures, and a near-inertial wave energy signature that is characterized by an approximately time-periodic, azimuthally invariant pattern. The wave-averaged model represents the nonlinear feedback of the waves on the vortex via a wave-induced contribution to the potential vorticity that is proportional to the Laplacian of the kinetic energy density of the waves. When this is taken into account, the modal frequency is predicted to increase linearly with the energy of the initial excitation. Both linear and nonlinear predictions agree convincingly with the Boussinesq results.


title: Class-incremental Learning with Pre-allocated Fixed Classifiers

abstract: In class-incremental learning, a learning agent faces a stream of data with the goal of learning new classes while not forgetting previous ones. Neural networks are known to suffer under this setting, as they forget previously acquired knowledge. To address this problem, effective methods exploit past data stored in an episodic memory while expanding the final classifier nodes to accommodate the new classes. In this work, we substitute the expanding classifier with a novel fixed classifier in which a number of pre-allocated output nodes are subject to the classification loss right from the beginning of the learning phase. Contrarily to the standard expanding classifier, this allows: (a) the output nodes of future unseen classes to firstly see negative samples since the beginning of learning together with the positive samples that incrementally arrive; (b) to learn features that do not change their geometric configuration as novel classes are incorporated in the learning model. Experiments with public datasets show that the proposed approach is as effective as the expanding classifier while exhibiting novel intriguing properties of the internal feature representation that are otherwise not-existent. Our ablation study on pre-allocating a large number of classes further validates the approach.


title: Wireless Localisation in WiFi using Novel Deep Architectures

abstract: This paper studies the indoor localisation of WiFi devices based on a commodity chipset and standard channel sounding. First, we present a novel shallow neural network (SNN) in which features are extracted from the channel state information (CSI) corresponding to WiFi subcarriers received on different antennas and used to train the model. The single-layer architecture of this localisation neural network makes it lightweight and easy-to-deploy on devices with stringent constraints on computational resources. We further investigate for localisation the use of deep learning models and design novel architectures for convolutional neural network (CNN) and long-short term memory (LSTM). We extensively evaluate these localisation algorithms for continuous tracking in indoor environments. Experimental results prove that even an SNN model, after a careful handcrafted feature extraction, can achieve accurate localisation. Meanwhile, using a well-organised architecture, the neural network models can be trained directly with raw data from the CSI and localisation features can be automatically extracted to achieve accurate position estimates. We also found that the performance of neural network-based methods are directly affected by the number of anchor access points (APs) regardless of their structure. With three APs, all neural network models proposed in this paper can obtain localisation accuracy of around 0.5 metres. In addition the proposed deep NN architecture reduces the data pre-processing time by 6.5 hours compared with a shallow NN using the data collected in our testbed. In the deployment phase, the inference time is also significantly reduced to 0.1 ms per sample. We also demonstrate the generalisation capability of the proposed method by evaluating models using different target movement characteristics to the ones in which they were trained.


title: Hot-Get-Richer Network Growth Model

abstract: Under preferential attachment (PA) network growth models late arrivals are at a disadvantage with regard to their final degrees. Previous extensions of PA have addressed this deficiency by either adding the notion of node fitness to PA, usually drawn from some fitness score distributions, or by using fitness alone to control attachment. Here we introduce a new dynamical approach to address late arrivals by adding a recent-degree-change bias to PA so that nodes with higher relative degree change in temporal proximity to an arriving node get an attachment probability boost. In other words, if PA describes a rich-get-richer mechanism, and fitness-based approaches describe good-get-richer mechanisms, then our model can be characterized as a hot-get-richer mechanism, where hotness is determined by the rate of degree change over some recent past. The proposed model produces much later high-ranking nodes than the PA model and, under certain parameters, produces networks with structure similar to PA networks.


title: Semantics of the Black-Box: Can knowledge graphs help make deep learning systems more interpretable and explainable?

abstract: The recent series of innovations in deep learning (DL) have shown enormous potential to impact individuals and society, both positively and negatively. The DL models utilizing massive computing power and enormous datasets have significantly outperformed prior historical benchmarks on increasingly difficult, well-defined research tasks across technology domains such as computer vision, natural language processing, signal processing, and human-computer interactions. However, the Black-Box nature of DL models and their over-reliance on massive amounts of data condensed into labels and dense representations poses challenges for interpretability and explainability of the system. Furthermore, DLs have not yet been proven in their ability to effectively utilize relevant domain knowledge and experience critical to human understanding. This aspect is missing in early data-focused approaches and necessitated knowledge-infused learning and other strategies to incorporate computational knowledge. This article demonstrates how knowledge, provided as a knowledge graph, is incorporated into DL methods using knowledge-infused learning, which is one of the strategies. We then discuss how this makes a fundamental difference in the interpretability and explainability of current approaches, and illustrate it with examples from natural language processing for healthcare and education applications.


title: Generalized Intersection Algorithms with Fixpoints for Image Decomposition Learning

abstract: In image processing, classical methods minimize a suitable functional that balances between computational feasibility (convexity of the functional is ideal) and suitable penalties reflecting the desired image decomposition. The fact that algorithms derived from such minimization problems can be used to construct (deep) learning architectures has spurred the development of algorithms that can be trained for a specifically desired image decomposition, e.g. into cartoon and texture. While many such methods are very successful, theoretical guarantees are only scarcely available. To this end, in this contribution, we formalize a general class of intersection point problems encompassing a wide range of (learned) image decomposition models, and we give an existence result for a large subclass of such problems, i.e. giving the existence of a fixpoint of the corresponding algorithm. This class generalizes classical model-based variational problems, such as the TV-l2 -model or the more general TV-Hilbert model. To illustrate the potential for learned algorithms, novel (non learned) choices within our class show comparable results in denoising and texture removal.


title: Correlated Energy-Level Alignment Effects Determine Substituent-Tuned Single-Molecule Conductance

abstract: The rational design of single molecule electrical components requires a deep and predictive understanding of structure-function relationships. Here we explore the relationship between chemical substituents and the conductance of metal-single molecule-metal junctions, using functionalized oligophenylenevinylenes as a model system. Using a combination of mechanically controlled break-junction experiments and various levels of theory including non-equilibrium Green's functions, we demonstrate that the connection between gas-phase molecular electronic structure and in-junction molecular conductance is complicated by the involvement of multiple mutually correlated and opposing effects that contribute to energy level alignment in the junction. We propose that these opposing correlations represent powerful new "design principles," because their physical origins make them broadly applicable, and they are capable of predicting the direction and relative magnitude of observed conductance trends. In particular, we show that they are consistent with the observed conductance variability not just within our own experimental results, but also within disparate molecular series reported in literature and, crucially, with the trend in variability across these molecular series, which previous simple models fail to explain. The design principles introduced here can therefore aid in both screening and suggesting novel design strategies for maximizing conductance tunability in single-molecule systems.


title: Just-in-Time Learning for Bottom-Up Enumerative Synthesis

abstract: A key challenge in program synthesis is the astronomical size of the search space the synthesizer has to explore. In response to this challenge, recent work proposed to guide synthesis using learned probabilistic models. Obtaining such a model, however, might be infeasible for a problem domain where no high-quality training data is available. In this work we introduce an alternative approach to guided program synthesis: instead of training a model ahead of time we show how to bootstrap one just in time, during synthesis, by learning from partial solutions encountered along the way. To make the best use of the model, we also propose a new program enumeration algorithm we dub guided bottom-up search, which extends the efficient bottom-up search with guidance from probabilistic models. We implement this approach in a tool called Probe, which targets problems in the popular syntax-guided synthesis (SyGuS) format. We evaluate Probe on benchmarks from the literature and show that it achieves significant performance gains both over unguided bottom-up search and over a state-of-the-art probability-guided synthesizer, which had been trained on a corpus of existing solutions. Moreover, we show that these performance gains do not come at the cost of solution quality: programs generated by Probe are only slightly more verbose than the shortest solutions and perform no unnecessary case-splitting.


title: On some subclasses of circular-arc catch digraphs

abstract: Catch digraphs was introduced by Hiroshi Maehara in 1984 as an analog of intersection graphs where a family of pointed sets represents a digraph. After that Prisner continued his research particularly on interval catch digraphs by characterizing them diasteroidal triple free. It has numerous applications in the field of real world problems like network technology and telecommunication operations. Recently, we characterized three important subclasses of interval catch digraphs. In this article we introduce a new class of catch digraphs, namely circular-arc catch digraphs. The definition is same as interval catch digraph, only the intervals are replaced by circular-arcs here. We present the characterization of proper circular-arc catch digraphs, which is a natural subclass of circular-arc catch digraphs where no circular-arc is contained in other properly. For this we introduce a concept, namely monotone circular ordering for the vertices of the augmented adjacency matrix of it. Next we find that underlying graph of a proper oriented circular-arc catch digraph is a proper circular-arc graph. Also we characterize proper oriented circular-arc catch digraphs by defining a certain kind of circular vertex ordering of its vertices. Another interesting result is to characterize oriented circular-arc catch digraphs which are tournaments in terms of forbidden subdigraphs. Further we study some properties of an oriented circular-arc catch digraph. In conclusion we discuss the relations between these subclasses of circular-arc catch digraphs.


title: The fate of the false vacuum: Finite temperature, entropy and topological phase in quantum simulations of the early universe

abstract: Despite being at the heart of the theory of the "Big Bang" and cosmic inflation, the quantum field theory prediction of false vacuum tunneling has not been tested. To address the exponential complexity of the problem, a table-top quantum simulator in the form of an engineered Bose-Einstein condensate (BEC) has been proposed to give dynamical solutions of the quantum field equations. In this paper, we give a numerical feasibility study of the BEC quantum simulator under realistic conditions and temperatures, with an approximate truncated Wigner (tW) phase-space method. We report the observation of false vacuum tunneling in these simulations, and the formation of multiple bubble 'universes' with distinct topological properties. The tunneling gives a transition of the relative phase of coupled Bose fields from a metastable to a stable 'vacuum'. We include finite temperature effects that would be found in a laboratory experiment and also analyze the cut-off dependence of modulational instabilities in Floquet space. Our numerical phase-space model does not use thin-wall approximations, which are inapplicable to cosmologically interesting models. It is expected to give the correct quantum treatment including superpositions and entanglement during dynamics. By analyzing a nonlocal observable called the topological phase entropy (TPE), our simulations provide information about phase structure in the true vacuum. We observe a cooperative effect in which the true vacua bubbles representing distinct universes each have one or the other of two distinct topologies. The TPE initially increases with time, reaching a peak as the multiple universes are formed, and then decreases with time to the phase-ordered vacuum state. This gives a model for the formation of universes with one of two distinct phases, which is a possible solution to the problem of particle-antiparticle asymmetry.


title: Active Domain Adaptation via Clustering Uncertainty-weighted Embeddings

abstract: Generalizing deep neural networks to new target domains is critical to their real-world utility. In practice, it may be feasible to get some target data labeled, but to be cost-effective it is desirable to select a maximally-informative subset via active learning (AL). We study the problem of AL under a domain shift, called Active Domain Adaptation (Active DA). We demonstrate how existing AL approaches based solely on model uncertainty or diversity sampling are less effective for Active DA. We propose Clustering Uncertainty-weighted Embeddings (CLUE), a novel label acquisition strategy for Active DA that performs uncertainty-weighted clustering to identify target instances for labeling that are both uncertain under the model and diverse in feature space. CLUE consistently outperforms competing label acquisition strategies for Active DA and AL across learning settings on 6 diverse domain shifts for image classification.


title: Combinatorics and Geometry for the Many-ported, Distributed and Shared Memory Architecture

abstract: Manycore SoC architectures based on on-chip shared memory are preferred for flexible and programmable solutions in many application domains. However, the development of many ported memory is becoming increasingly challenging as we approach the end of Moore's Law while systems requirements demand larger shared memory and more access ports. Memory can no longer be designed simply to minimize single transaction access time, but must take into account the functionality on the SoC. In this paper we examine a common large memory usage in SoC, where the memory is used as storage for large buffers that are then moved for time scheduled processing. We merge two aspects of many ported memory design, combinatorial analysis of interconnect, and geometric analysis of critical paths, extending both to show that in this case the SoC performance benefits significantly from a hierarchical, distributed and staged architecture with lower-radix switches and fractal randomization of memory bank addressing, along with judicious and geometry aware application of speed up. The results presented show the new architecture supports 20% higher throughput with 20% lower latency and 30% less interconnection area at approximately the same power consumption. We demonstrate the flexibility and scalability of this architecture on silicon from a physical design perspective by taking the design through layout. The architecture enables a much easier implementation flow that works well with physically irregular port access and memory dominant layout, which is a common issue in real designs.


title: Investigating orientation effects considering angular resolution for a sample of radio-loud quasars using VLA observations

abstract: Radio core dominance measurements, an indicator of jet orientation, sometimes rely on core flux density measurements from large-area surveys like Faint Images of the Radio Sky at Twenty cm (FIRST) that have an angular resolution of only 5''. Such low-resolution surveys often fail to resolve cores from the extended emission resulting in an erroneous measurement. We focus on investigating this resolution effect for a sample of 119 radio-loud quasars. We obtained continuum observations from NSF's Karl G. Jansky Very Large Array (VLA) at 10 GHz in A-array with a 0.2'' resolution. Our measurements show that at FIRST spatial resolution, core flux measurements are indeed systematically high even after considering the core-variability. For a handful of quasars, 10 GHz images reveal extended features, whereas the FIRST image shows a point source. We found that the resolution effect is more prominent for quasars with smaller angular sizes. We further computed two radio core dominance parameters R & R5100 for use in statistical orientation investigations with this sample. We also present the spectral energy distributions between 74 MHz and 1.4 GHz, which we used to measure the spectral index of the extended emission of these quasars. Our results empirically confirm that determination of radio core dominance requires high-spatial resolution data. We highlight the practical issues associated with the choice of frequency and resolution in the measurement of core and extended flux densities.


title: Robot Learning with Crash Constraints

abstract: In the past decade, numerous machine learning algorithms have been shown to successfully learn optimal policies to control real robotic systems. However, it is common to encounter failing behaviors as the learning loop progresses. Specifically, in robot applications where failing is undesired but not catastrophic, many algorithms struggle with leveraging data obtained from failures. This is usually caused by (i) the failed experiment ending prematurely, or (ii) the acquired data being scarce or corrupted. Both complicate the design of proper reward functions to penalize failures. In this paper, we propose a framework that addresses those issues. We consider failing behaviors as those that violate a constraint and address the problem of learning with crash constraints, where no data is obtained upon constraint violation. The no-data case is addressed by a novel GP model (GPCR) for the constraint that combines discrete events (failure/success) with continuous observations (only obtained upon success). We demonstrate the effectiveness of our framework on simulated benchmarks and on a real jumping quadruped, where the constraint threshold is unknown a priori. Experimental data is collected, by means of constrained Bayesian optimization, directly on the real robot. Our results outperform manual tuning and GPCR proves useful on estimating the constraint threshold.


title: CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understanding

abstract: Data augmentation has been demonstrated as an effective strategy for improving model generalization and data efficiency. However, due to the discrete nature of natural language, designing label-preserving transformations for text data tends to be more challenging. In this paper, we propose a novel data augmentation framework dubbed CoDA, which synthesizes diverse and informative augmented examples by integrating multiple transformations organically. Moreover, a contrastive regularization objective is introduced to capture the global relationship among all the data samples. A momentum encoder along with a memory bank is further leveraged to better estimate the contrastive loss. To verify the effectiveness of the proposed framework, we apply CoDA to Transformer-based models on a wide range of natural language understanding tasks. On the GLUE benchmark, CoDA gives rise to an average improvement of 2.2% while applied to the RoBERTa-large model. More importantly, it consistently exhibits stronger results relative to several competitive data augmentation and adversarial training base-lines (including the low-resource settings). Extensive experiments show that the proposed contrastive objective can be flexibly combined with various data augmentation approaches to further boost their performance, highlighting the wide applicability of the CoDA framework.


title: On a family of non-weight modules over Virasoro-type Lie (super)algebras

abstract: In this thesis we classify modules over a Witt-type Lie algebra and superalgebra such that when considered as modules of $\mathcal{U}(\mathfrak{h})$ they are free of rank 1. We provide sufficient conditions for simplicity, and compute the action of an automorphism on the module. Lastly, we apply the weighting functor and show that the resulting modules are intermediate series modules.


title: On Banzhaf and Shapley-Shubik Fixed Points and Divisor Voting Systems

abstract: The Banzhaf and Shapley-Shubik power indices were first introduced to measure the power of voters in a weighted voting system. Given a weighted voting system, the fixed point of such a system is found by continually reassigning each voter's weight with its power index until the system can no longer be changed by the operation. We characterize all fixed points under the Shapley-Shubik power index of the form $(a,b,\ldots,b)$ and give an algebraic equation which can verify in principle whether a point of this form is fixed for Banzhaf; we also generate Shapley-Shubik fixed classes of the form $(a,a,b,\ldots,b)$. We also investigate the indices of divisor voting systems of abundant numbers and prove that the Banzhaf and Shapley-Shubik indices differ for some cases.


title: Significance testing for canonical correlation analysis in high dimensions

abstract: We consider the problem of testing for the presence of linear relationships between large sets of random variables based on a post-selection inference approach to canonical correlation analysis. The challenge is to adjust for the selection of subsets of variables having linear combinations with maximal sample correlation. To this end, we construct a stabilized one-step estimator of the euclidean-norm of the canonical correlations maximized over subsets of variables of pre-specified cardinality. This estimator is shown to be consistent for its target parameter and asymptotically normal provided the dimensions of the variables do not grow too quickly with sample size. We also develop a greedy search algorithm to accurately compute the estimator, leading to a computationally tractable omnibus test for the global null hypothesis that there are no linear relationships between any subsets of variables having the pre-specified cardinality. Further, we develop a confidence interval for the target parameter that takes the variable selection into account.


title: Creation and confirmation of Hopfions in magnetic multilayer systems

abstract: Topological solitons have been studied for decades in classical field theories, and have started recently to impact condensed matter physics. Among those solitons, magnetic skyrmions are two-dimensional particle-like objects with a continuous winding of the magnetization, and magnetic Hopfions are three-dimensional topological solitons that can be formed from a closed loop of a twisted skyrmion string. Whereas intense research is underway with magnetic skyrmions towards a fundamental understanding and potential applications in advanced storage and logic devices, the experimental creation and confirmation of magnetic Hopfions has been elusive so far. Theoretical models suggest that Hopfions can be stabilized in frustrated or chiral magnetic systems, and that target skymions can be transformed into Hopfions by adapting their perpendicular magnetic anisotropy. Here, we present experimental evidence of magnetic Hopfions that were created in magnetic Ir/Co/Pt multilayers shaped into nanoscale disks, which are known to host target skyrmions. The three-dimensional spin texture, which distinguishes magnetic Hopfions from target skyrmions was confirmed by combining two advanced element-specific magnetic X-ray microscopy techniques with about 20-30nm lateral resolution, using X-ray magnetic circular dichroism effect as magnetic contrast mechanism in surface-sensitive X-ray photoemission electron microscopy and bulk-sensitive soft x-ray transmission microscopy. We anticipate that these results will stimulate further investigations of Hopfions with different topologies and their potential application in three-dimensional spintronics devices.


title: Long-Term Face Tracking for Crowded Video-Surveillance Scenarios

abstract: Most current multi-object trackers focus on short-term tracking, and are based on deep and complex systems that do not operate in real-time, often making them impractical for video-surveillance. In this paper, we present a long-term multi-face tracking architecture conceived for working in crowded contexts, particularly unconstrained in terms of movement and occlusions, and where the face is often the only visible part of the person. Our system benefits from advances in the fields of face detection and face recognition to achieve long-term tracking. It follows a tracking-by-detection approach, combining a fast short-term visual tracker with a novel online tracklet reconnection strategy grounded on face verification. Additionally, a correction module is included to correct past track assignments with no extra computational cost. We present a series of experiments introducing novel, specialized metrics for the evaluation of long-term tracking capabilities and a video dataset that we publicly release. Findings demonstrate that, in this context, our approach allows to obtain up to 50% longer tracks than state-of-the-art deep learning trackers.


title: Fast Spatial Autocorrelation

abstract: Physical or geographic location proves to be an important feature in many data science models, because many diverse natural and social phenomenon have a spatial component. Spatial autocorrelation measures the extent to which locally adjacent observations of the same phenomenon are correlated. Although statistics like Moran's $I$ and Geary's $C$ are widely used to measure spatial autocorrelation, they are slow: all popular methods run in $\Omega(n^2)$ time, rendering them unusable for large data sets, or long time-courses with moderate numbers of points. We propose a new $S_A$ statistic based on the notion that the variance observed when merging pairs of nearby clusters should increase slowly for spatially autocorrelated variables. We give a linear-time algorithm to calculate $S_A$ for a variable with an input agglomeration order (available at https://github.com/aamgalan/spatial_autocorrelation). For a typical dataset of $n \approx 63,000$ points, our $S_A$ autocorrelation measure can be computed in 1 second, versus 2 hours or more for Moran's $I$ and Geary's $C$. Through simulation studies, we demonstrate that $S_A$ identifies spatial correlations in variables generated with spatially-dependent model half an order of magnitude earlier than either Moran's $I$ or Geary's $C$. Finally, we prove several theoretical properties of $S_A$: namely that it behaves as a true correlation statistic, and is invariant under addition or multiplication by a constant.


title: Closed-form Br\"uckner $G$-matrix and nuclear matter in EFT($\not\!\pi$)

abstract: The closed-form Br\"ukner $G$ matrix for nuclear matter is computed in the $^1S_0$ channel of EFT($\not\!\!\pi$) and renormalized in nonperturbative context. The nuclear medium environment yields additional constraints that are consistent with off-shell $T$ matrix renormalization, keeping the power counting intact and simplifying the running behaviors of the EFT couplings. With the $G$ obtained we computed the energy per particle for neutron and symmetric nuclear matter to demonstrate the physical relevance of certain 'physical' parameters that arise from nonperturbative renormalization. We also explored the pairing phenomenon in $^1S_0$ channel by examining the poles of the closed-form $G$ matrix with a given density, where again the physical relevance of the same set of physical parameters are clearly illustrated.


title: TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems

abstract: Deep learning inference on embedded devices is a burgeoning field with myriad applications because tiny embedded devices are omnipresent. But we must overcome major challenges before we can benefit from this opportunity. Embedded processors are severely resource constrained. Their nearest mobile counterparts exhibit at least a 100 -- 1,000x difference in compute capability, memory availability, and power consumption. As a result, the machine-learning (ML) models and associated ML inference framework must not only execute efficiently but also operate in a few kilobytes of memory. Also, the embedded devices' ecosystem is heavily fragmented. To maximize efficiency, system vendors often omit many features that commonly appear in mainstream systems, including dynamic memory allocation and virtual memory, that allow for cross-platform interoperability. The hardware comes in many flavors (e.g., instruction-set architecture and FPU support, or lack thereof). We introduce TensorFlow Lite Micro (TF Micro), an open-source ML inference framework for running deep-learning models on embedded systems. TF Micro tackles the efficiency requirements imposed by embedded-system resource constraints and the fragmentation challenges that make cross-platform interoperability nearly impossible. The framework adopts a unique interpreter-based approach that provides flexibility while overcoming these challenges. This paper explains the design decisions behind TF Micro and describes its implementation details. Also, we present an evaluation to demonstrate its low resource requirement and minimal run-time performance overhead.


title: Check-N-Run: A Checkpointing System for Training Deep Learning Recommendation Models

abstract: Checkpoints play an important role in training long running machine learning (ML) models. Checkpoints take a snapshot of an ML model and store it in a non-volatile memory so that they can be used to recover from failures to ensure rapid training progress. In addition, they are used for online training to improve inference prediction accuracy with continuous learning. Given the large and ever increasing model sizes, checkpoint frequency is often bottlenecked by the storage write bandwidth and capacity. When checkpoints are maintained on remote storage, as is the case with many industrial settings, they are also bottlenecked by network bandwidth. We present Check-N-Run, a scalable checkpointing system for training large ML models at Facebook. While Check-N-Run is applicable to long running ML jobs, we focus on checkpointing recommendation models which are currently the largest ML models with Terabytes of model size. Check-N-Run uses two primary techniques to address the size and bandwidth challenges. First, it applies incremental checkpointing, which tracks and checkpoints the modified part of the model. Incremental checkpointing is particularly valuable in the context of recommendation models where only a fraction of the model (stored as embedding tables) is updated on each iteration. Second, Check-N-Run leverages quantization techniques to significantly reduce the checkpoint size, without degrading training accuracy. These techniques allow Check-N-Run to reduce the required write bandwidth by 6-17x and the required capacity by 2.5-8x on real-world models at Facebook, and thereby significantly improve checkpoint capabilities while reducing the total cost of ownership.


title: Combining strong and weak lensing estimates in the Cosmos field

abstract: We present a combined cosmic shear analysis of the modeling of line-of-sight distortions on strongly lensed extended arcs and galaxy shape measurements in the COSMOS field. We develop a framework to predict the covariance of strong lensing and galaxy shape measurements of cosmic shear on the basis of the small scale matter power-spectrum. The weak lensing measurement is performed using data from the COSMOS survey calibrated with a cloning scheme using the Ultra Fast Image Generator UFig (Berge 2013). The strong lensing analysis is performed by forward modeling the lensing arcs with a main lensing deflector and external shear components from the same Hubble Space Telescope imaging data set. With a sample of three strong lensing shear measurements we present a 2-sigma detection of the cross-correlation signal between the two complementary measurements of cosmic shear along the identical line of sight. With large samples of lenses available with the next generation ground and space based observatories, the covariance of the signal of the two probes with large samples of lenses allows for systematic checks, cross-calibration of either of the two measurement and the measurement of the small scale shear power-spectrum.


title: New Estimates on the bounds of Brunel's operator

abstract: We study the coefficients of the Taylor series expansion of powers of the function $\psi(x)=\frac{1-\sqrt{1-x}}{x}$, where the Brunel operator $A\equiv A(T)$ is defined as $\psi(T)$ for any mean-bounded $T$. We prove several new precise estimates regarding the Taylor coefficients of $\psi^n$ for $n\in\mathbb{N}$. We apply these estimates to give an elementary proof that for any mean-bounded, not necessarily positive operator $T$ on a Banach space $X$, the Brunel operator $A(T):X\to X$ is power-bounded and satisfies $\sup_{n\in\mathbb{N}} \|n(A^n-A^{n+1})\| < \infty$ (equivalently, $A(T)$ is a Ritt operator). Along the way we provide specific details of results announced by A. Brunel and R. Emilion in \cite{Brunel}.


title: MeshMVS: Multi-View Stereo Guided Mesh Reconstruction

abstract: Deep learning based 3D shape generation methods generally utilize latent features extracted from color images to encode the semantics of objects and guide the shape generation process. These color image semantics only implicitly encode 3D information, potentially limiting the accuracy of the generated shapes. In this paper we propose a multi-view mesh generation method which incorporates geometry information explicitly by using the features from intermediate depth representations of multi-view stereo and regularizing the 3D shapes against these depth images. First, our system predicts a coarse 3D volume from the color images by probabilistically merging voxel occupancy grids from the prediction of individual views. Then the depth images from multi-view stereo along with the rendered depth images of the coarse shape are used as a contrastive input whose features guide the refinement of the coarse shape through a series of graph convolution networks. Notably, we achieve superior results than state-of-the-art multi-view shape generation methods with 34% decrease in Chamfer distance to ground truth and 14% increase in F1-score on ShapeNet dataset.Our source code is available at https://git.io/Jmalg


title: A Precise Photometric Ratio via Laser Excitation of the Sodium Layer II: Two-photon Excitation Using Lasers Detuned from 589.16 nm and 819.71 nm Resonances

abstract: This article is the second in a pair of articles on the topic of the generation of a two-color artificial star (which we term a "laser photometric ratio star," or LPRS) of de-excitation light from neutral sodium atoms in the mesosphere, for use in precision telescopic measurements in astronomy and atmospheric physics, and more specifically for the calibration of measurements of dark energy using type Ia supernovae. The two techniques respectively described in both this and the previous article would each generate an LPRS with a precisely 1:1 ratio of yellow (589/590 nm) photons to near-infrared (819/820 nm) photons produced in the mesosphere. Both techniques would provide novel mechanisms for establishing a spectrophotometric calibration ratio of unprecedented precision, from above most of Earth's atmosphere, for upcoming telescopic observations across astronomy and atmospheric physics. The technique described in this article has the advantage of producing a much brighter (specifically, brighter by approximately a factor of 1000) LPRS, using lower-power (<30 W average power) lasers, than the technique using a single 500 W average power laser described in the first article of this pair. However, the technique described here would require polarization filters to be installed into the telescope camera in order to sufficiently remove laser atmospheric Rayleigh backscatter from telescope images, whereas the technique described in the first article would only require more typical wavelength filters in order to sufficiently remove laser Rayleigh backscatter.


title: Example-Driven Intent Prediction with Observers

abstract: A key challenge of dialog systems research is to effectively and efficiently adapt to new domains. A scalable paradigm for adaptation necessitates the development of generalizable models that perform well in few-shot settings. In this paper, we focus on the intent classification problem which aims to identify user intents given utterances addressed to the dialog system. We propose two approaches for improving the generalizability of utterance classification models: (1) observers and (2) example-driven training. Prior work has shown that BERT-like models tend to attribute a significant amount of attention to the [CLS] token, which we hypothesize results in diluted representations. Observers are tokens that are not attended to, and are an alternative to the [CLS] token as a semantic representation of utterances. Example-driven training learns to classify utterances by comparing to examples, thereby using the underlying encoder as a sentence similarity model. These methods are complementary; improving the representation through observers allows the example-driven model to better measure sentence similarities. When combined, the proposed methods attain state-of-the-art results on three intent prediction datasets (\textsc{banking77}, \textsc{clinc150}, \textsc{hwu64}) in both the full data and few-shot (10 examples per intent) settings. Furthermore, we demonstrate that the proposed approach can transfer to new intents and across datasets without any additional training.


title: Observation of resonant dipolar collisions in ultracold $^{23}$Na$^{87}$Rb rotational mixtures

abstract: We report the investigation on dipolar collisions in rotational state mixtures of ultracold bosonic $^{23}$Na$^{87}$Rb molecules. The large resonant dipole-dipole interaction between molecules in rotational states of opposite parities brings about significant modifications to their collisions, even when an electric field is not present. In this work, this effect is revealed by measuring the dramatically enhanced two-body loss rate constants in the mixtures. In addition, the dipolar interaction strength can be tuned by preparing the NaRb mixture in different rotational levels with microwave spectroscopy. When the rotational level combination is not of the lowest energy, contributions from hyperfine changing collisions are also observed. Our measured loss rate constants are in good agreement with a quantum close-coupling calculation which we also present in full detail.


title: NEO: A Novel Expeditious Optimisation Algorithm for Reactive Motion Control of Manipulators

abstract: We present NEO, a fast and purely reactive motion controller for manipulators which can avoid static and dynamic obstacles while moving to the desired end-effector pose. Additionally, our controller maximises the manipulability of the robot during the trajectory, while avoiding joint position and velocity limits. NEO is wrapped into a strictly convex quadratic programme which, when considering obstacles, joint limits, and manipulability on a 7 degree-of-freedom robot, is generally solved in a few ms. While NEO is not intended to replace state-of-the-art motion planners, our experiments show that it is a viable alternative for scenes with moderate complexity while also being capable of reactive control. For more complex scenes, NEO is better suited as a reactive local controller, in conjunction with a global motion planner. We compare NEO to motion planners on a standard benchmark in simulation and additionally illustrate and verify its operation on a physical robot in a dynamic environment. We provide an open-source library which implements our controller.


title: Learning a Continuous Representation of 3D Molecular Structures with Deep Generative Models

abstract: Machine learning in drug discovery has been focused on virtual screening of molecular libraries using discriminative models. Generative models are an entirely different approach that learn to represent and optimize molecules in a continuous latent space. These methods have been increasingly successful at generating two dimensional molecules as SMILES strings and molecular graphs. In this work, we describe deep generative models of three dimensional molecular structures using atomic density grids and a novel fitting algorithm for converting continuous grids to discrete molecular structures. Our models jointly represent drug-like molecules and their conformations in a latent space that can be explored through interpolation. We are also able to sample diverse sets of molecules based on a given input compound and increase the probability of creating valid, drug-like molecules.


title: Locally Differentially Private Analysis of Graph Statistics

abstract: Differentially private analysis of graphs is widely used for releasing statistics from sensitive graphs while still preserving user privacy. Most existing algorithms however are in a centralized privacy model, where a trusted data curator holds the entire graph. As this model raises a number of privacy and security issues -- such as, the trustworthiness of the curator and the possibility of data breaches, it is desirable to consider algorithms in a more decentralized local model where no server holds the entire graph. In this work, we consider a local model, and present algorithms for counting subgraphs -- a fundamental task for analyzing the connection patterns in a graph -- with LDP (Local Differential Privacy). For triangle counts, we present algorithms that use one and two rounds of interaction, and show that an additional round can significantly improve the utility. For $k$-star counts, we present an algorithm that achieves an order optimal estimation error in the non-interactive local model. We provide new lower-bounds on the estimation error for general graph statistics including triangle counts and $k$-star counts. Finally, we perform extensive experiments on two real datasets, and show that it is indeed possible to accurately estimate subgraph counts in the local differential privacy model.


title: Towards Compact Neural Networks via End-to-End Training: A Bayesian Tensor Approach with Automatic Rank Determination

abstract: While post-training model compression can greatly reduce the inference cost of a deep neural network, uncompressed training still consumes a huge amount of hardware resources, run-time and energy. It is highly desirable to directly train a compact neural network from scratch with low memory and low computational cost. Low-rank tensor decomposition is one of the most effective approaches to reduce the memory and computing requirements of large-size neural networks. However, directly training a low-rank tensorized neural network is a very challenging task because it is hard to determine a proper tensor rank {\it a priori}, which controls the model complexity and compression ratio in the training process. This paper presents a novel end-to-end framework for low-rank tensorized training of neural networks. We first develop a flexible Bayesian model that can handle various low-rank tensor formats (e.g., CP, Tucker, tensor train and tensor-train matrix) that compress neural network parameters in training. This model can automatically determine the tensor ranks inside a nonlinear forward model, which is beyond the capability of existing Bayesian tensor methods. We further develop a scalable stochastic variational inference solver to estimate the posterior density of large-scale problems in training. Our work provides the first general-purpose rank-adaptive framework for end-to-end tensorized training. Our numerical results on various neural network architectures show orders-of-magnitude parameter reduction and little accuracy loss (or even better accuracy) in the training process. Specifically, on a very large deep learning recommendation system with over $4.2\times 10^9$ model parameters, our method can reduce the variables to only $1.6\times 10^5$ automatically in the training process (i.e., by $2.6\times 10^4$ times) while achieving almost the same accuracy.


title: Optoelectronic Intelligence

abstract: To design and construct hardware for general intelligence, we must consider principles of both neuroscience and very-large-scale integration. For large neural systems capable of general intelligence, the attributes of photonics for communication and electronics for computation are complementary and interdependent. Using light for communication enables high fan-out as well as low-latency signaling across large systems with no traffic-dependent bottlenecks. For computation, the inherent nonlinearities, high speed, and low power consumption of Josephson circuits are conducive to complex neural functions. Operation at 4\,K enables the use of single-photon detectors and silicon light sources, two features that lead to efficiency and economical scalability. Here I sketch a concept for optoelectronic hardware, beginning with synaptic circuits, continuing through wafer-scale integration, and extending to systems interconnected with fiber-optic white matter, potentially at the scale of the human brain and beyond.


title: Automatic Tree Ring Detection using Jacobi Sets

abstract: Tree ring widths are an important source of climatic and historical data, but measuring these widths typically requires extensive manual work. Computer vision techniques provide promising directions towards the automation of tree ring detection, but most automated methods still require a substantial amount of user interaction to obtain high accuracy. We perform analysis on 3D X-ray CT images of a cross-section of a tree trunk, known as a tree disk. We present novel automated methods for locating the pith (center) of a tree disk, and ring boundaries. Our methods use a combination of standard image processing techniques and tools from topological data analysis. We evaluate the efficacy of our method for two different CT scans by comparing its results to manually located rings and centers and show that it is better than current automatic methods in terms of correctly counting each ring and its location. Our methods have several parameters, which we optimize experimentally by minimizing edit distances to the manually obtained locations.


title: A local Torelli theorem for log symplectic manifolds

abstract: We establish a local model for the moduli space of holomorphic symplectic structures with logarithmic poles, near the locus of structures whose polar divisor is normal crossings. In contrast to the case without poles, the moduli space is singular: when the cohomology class of a symplectic structure satisfies certain linear equations with integer coefficients, its polar divisor can be partially smoothed, yielding adjacent irreducible components of the moduli space that correspond to possibly non-normal crossings structures. These components are indexed by combinatorial data we call smoothing diagrams, and amenable to algorithmic classification. Applying the theory to four-dimensional projective space, we obtain a total of 40 irreducible components of the moduli space, most of which are new. Our main technique is a detailed analysis of the relevant deformation complex (the Poisson cohomology) as an object of the constructible derived category.


title: Binary matrix factorization on special purpose hardware

abstract: Many fundamental problems in data mining can be reduced to one or more NP-hard combinatorial optimization problems. Recent advances in novel technologies such as quantum and quantum-inspired hardware promise a substantial speedup for solving these problems compared to when using general purpose computers but often require the problem to be modeled in a special form, such as an Ising or quadratic unconstrained binary optimization (QUBO) model, in order to take advantage of these devices. In this work, we focus on the important binary matrix factorization (BMF) problem which has many applications in data mining. We propose two QUBO formulations for BMF. We show how clustering constraints can easily be incorporated into these formulations. The special purpose hardware we consider is limited in the number of variables it can handle which presents a challenge when factorizing large matrices. We propose a sampling based approach to overcome this challenge, allowing us to factorize large rectangular matrices. In addition to these methods, we also propose a simple baseline algorithm which outperforms our more sophisticated methods in a few situations. We run experiments on the Fujitsu Digital Annealer, a quantum-inspired complementary metal-oxide-semiconductor (CMOS) annealer, on both synthetic and real data, including gene expression data. These experiments show that our approach is able to produce more accurate BMFs than competing methods.