title: Coherent Springer theory and the categorical Deligne-Langlands correspondence

abstract: Kazhdan and Lusztig identified the affine Hecke algebra $\mathcal{H}$ with an equivariant $K$-group of the Steinberg variety, and applied this to prove the Deligne-Langlands conjecture, i.e., the local Langlands parametrization of irreducible representations of reductive groups over nonarchimedean local fields $F$ with an Iwahori-fixed vector. We apply techniques from derived algebraic geometry to pass from $K$-theory to Hochschild homology and thereby identify $\mathcal{H}$ with the endomorphisms of a coherent sheaf on the stack of unipotent Langlands parameters, the coherent Springer sheaf. As a result the derived category of $\mathcal{H}$-modules is realized as a full subcategory of coherent sheaves on this stack, confirming expectations from strong forms of the local Langlands correspondence (including recent conjectures of Fargues-Scholze, Hellmann and Zhu). In the case of the general linear group our result allows us to lift the local Langlands classification of irreducible representations to a categorical statement: we construct a full embedding of the derived category of smooth representations of $\mathrm{GL}_n(F)$ into coherent sheaves on the stack of Langlands parameters.


title: SeqMix: Augmenting Active Sequence Labeling via Sequence Mixup

abstract: Active learning is an important technique for low-resource sequence labeling tasks. However, current active sequence labeling methods use the queried samples alone in each iteration, which is an inefficient way of leveraging human annotations. We propose a simple but effective data augmentation method to improve the label efficiency of active sequence labeling. Our method, SeqMix, simply augments the queried samples by generating extra labeled sequences in each iteration. The key difficulty is to generate plausible sequences along with token-level labels. In SeqMix, we address this challenge by performing mixup for both sequences and token-level labels of the queried samples. Furthermore, we design a discriminator during sequence mixup, which judges whether the generated sequences are plausible or not. Our experiments on Named Entity Recognition and Event Detection tasks show that SeqMix can improve the standard active sequence labeling method by $2.27\%$--$3.75\%$ in terms of $F_1$ scores. The code and data for SeqMix can be found at https://github.com/rz-zhang/SeqMix


title: Exploring the Interchangeability of CNN Embedding Spaces

abstract: CNN feature spaces can be linearly mapped and consequently are often interchangeable. This equivalence holds across variations in architectures, training datasets, and network tasks. Specifically, we mapped between 10 image-classification CNNs and between 4 facial-recognition CNNs. When image embeddings generated by one CNN are transformed into embeddings corresponding to the feature space of a second CNN trained on the same task, their respective image classification or face verification performance is largely preserved. For CNNs trained to the same classes and sharing a common backend-logit (soft-max) architecture, a linear-mapping may always be calculated directly from the backend layer weights. However, the case of a closed-set analysis with perfect knowledge of classifiers is limiting. Therefore, empirical methods of estimating mappings are presented for both the closed-set image classification task and the open-set task of face recognition. The results presented expose the essentially interchangeable nature of CNNs embeddings for two important and common recognition tasks. The implications are far-reaching, suggesting an underlying commonality between representations learned by networks designed and trained for a common task. One practical implication is that face embeddings from some commonly used CNNs can be compared using these mappings.


title: A Query-Efficient Quantum Algorithm for Maximum Matching on General Graphs

abstract: We design quantum algorithms for maximum matching. Working in the query model, in both adjacency matrix and adjacency list settings, we improve on the best known algorithms for general graphs, matching previously obtained results for bipartite graphs. In particular, for a graph with $n$ nodes and $m$ edges, our algorithm makes $O(n^{7/4})$ queries in the matrix model and $O(n^{3/4}(m+n)^{1/2})$ queries in the list model. Our approach combines Gabow's classical maximum matching algorithm [Gabow, Fundamenta Informaticae, '17] with the guessing tree method of Beigi and Taghavi [Beigi and Taghavi, Quantum, '20].


title: Iterated differences sets, diophantine approximations and applications

abstract: Let $v$ be an odd real polynomial (i.e. a polynomial of the form $\sum_{j=1}^\ell a_jx^{2j-1}$). We utilize sets of iterated differences to establish new results about sets of the form $\mathcal R(v,\epsilon)=\{n\in\mathbb{N}\,|\,\|v(n)\|{<\epsilon\}}$ where $\|\cdot\|$ denotes the distance to the closest integer. We then apply the new diophantine results to obtain applications to ergodic theory and combinatorics. In particular, we obtain a new characterization of weakly mixing systems as well as a new variant of Furstenberg-S\'ark\"ozy theorem.


title: Determining the Number of Factors in High-dimensional Generalized Latent Factor Models

abstract: As a generalization of the classical linear factor model, generalized latent factor models are useful for analyzing multivariate data of different types, including binary choices and counts. This paper proposes an information criterion to determine the number of factors in generalized latent factor models. The consistency of the proposed information criterion is established under a high-dimensional setting where both the sample size and the number of manifest variables grow to infinity, and data may have many missing values. An error bound is established for the parameter estimates, which plays an important role in establishing the consistency of the proposed information criterion. This error bound improves several existing results and may be of independent theoretical interest. We evaluate the proposed method by a simulation study and an application to Eysenck's personality questionnaire.


title: Scalarly Essentially Integrable Locally Convex Vector Valued Tensor Fields. Stokes Theorem

abstract: This note is propaedeutic to the forthcoming work \cite{sil}; here we develop the terminology and results required by that paper. More specifically we introduce the concept of scalarly essentially integrable locally convex vector-valued tensor fields on a smooth manifold, generalize on them the usual operations, in case the manifold is oriented define the weak integral of scalarly essentially integrable locally convex vector-valued maximal forms and finally establish the extension of Stokes theorem for smooth locally convex vector-valued forms. This approach to the basic theory of scalarly essentially integrable and smooth locally convex vector-valued tensor fields seems to us to be new. Specifically are new (1) the definition of the space of scalarly essentially integrable locally convex vector-valued tensor fields as a $\mathcal{A}(U)$-tensor product, although motivated by a result in the usual smooth and real-valued context; (2) the procedure of $\mathcal{A}(U)$-linearizing $\mathcal{A}(U)$-bilinear maps in order to extend the usual operations especially the wedge product; (3) the exploitation of the uniqueness decomposition of the $\mathcal{A}(U)$-tensor product with a free module in order to define not only (a) the exterior differential of smooth locally convex vector-valued forms, but also (b) the weak integral of scalarly essentially integrable locally convex vector-valued maximal forms; (4) the use of the projective topological tensor product theory to define the wedge product.


title: G-Valued Crystalline Deformation Rings in the Fontaine-Laffaille Range

abstract: Let $G$ be a split reductive group over the ring of integers in a $p$-adic field with residue field $\mathbf{F}$. Fix a representation $\overline{\rho}$ of the absolute Galois group of an unramified extension of $\mathbf{Q}_p$, valued in $G(\mathbf{F})$. We study the crystalline deformation ring for $\overline{\rho}$ with a fixed $p$-adic Hodge type that satisfies an analog of the Fontaine-Laffaille condition for $G$-valued representations. In particular, we give a root theoretic condition on the $p$-adic Hodge type which ensures that the crystalline deformation ring is formally smooth. Our result improves on all known results for classical groups not of type A and provides the first such results for exceptional groups.


title: InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective

abstract: Large-scale language models such as BERT have achieved state-of-the-art performance across a wide range of NLP tasks. Recent studies, however, show that such BERT-based models are vulnerable facing the threats of textual adversarial attacks. We aim to address this problem from an information-theoretic perspective, and propose InfoBERT, a novel learning framework for robust fine-tuning of pre-trained language models. InfoBERT contains two mutual-information-based regularizers for model training: (i) an Information Bottleneck regularizer, which suppresses noisy mutual information between the input and the feature representation; and (ii) a Robust Feature regularizer, which increases the mutual information between local robust features and global features. We provide a principled way to theoretically analyze and improve the robustness of representation learning for language models in both standard and adversarial training. Extensive experiments demonstrate that InfoBERT achieves state-of-the-art robust accuracy over several adversarial datasets on Natural Language Inference (NLI) and Question Answering (QA) tasks. Our code is available at https://github.com/AI-secure/InfoBERT.


title: A Benchmark and Baseline for Language-Driven Image Editing

abstract: Language-driven image editing can significantly save the laborious image editing work and be friendly to the photography novice. However, most similar work can only deal with a specific image domain or can only do global retouching. To solve this new task, we first present a new language-driven image editing dataset that supports both local and global editing with editing operation and mask annotations. Besides, we also propose a baseline method that fully utilizes the annotation to solve this problem. Our new method treats each editing operation as a sub-module and can automatically predict operation parameters. Not only performing well on challenging user data, but such an approach is also highly interpretable. We believe our work, including both the benchmark and the baseline, will advance the image editing area towards a more general and free-form level.


title: How to send a real number using a single bit (and some shared randomness)

abstract: We consider the fundamental problem of communicating an estimate of a real number $x\in[0,1]$ using a single bit. A sender that knows $x$ chooses a value $X\in\set{0,1}$ to transmit. In turn, a receiver estimates $x$ based on the value of $X$. We consider both the biased and unbiased estimation problems and aim to minimize the cost. For the biased case, the cost is the worst-case (over the choice of $x$) expected squared error, which coincides with the variance if the algorithm is required to be unbiased. We first overview common biased and unbiased estimation approaches and prove their optimality when no shared randomness is allowed. We then show how a small amount of shared randomness, which can be as low as a single bit, reduces the cost in both cases. Specifically, we derive lower bounds on the cost attainable by any algorithm with unrestricted use of shared randomness and propose near-optimal solutions that use a small number of shared random bits. Finally, we discuss open problems and future directions.


title: Multi-scale graph principal component analysis for connectomics

abstract: In brain connectomics, the cortical surface is parcellated into different regions of interest (ROIs) prior to statistical analysis. The brain connectome for each individual can then be represented as a graph, with the nodes corresponding to ROIs and edges to connections between ROIs. Such a graph can be summarized as an adjacency matrix, with each cell containing the strength of connection between a pair of ROIs. These matrices are symmetric with the diagonal elements corresponding to self-connections typically excluded. A major disadvantage of such representations of the connectome is their sensitivity to the chosen ROIs, including critically the number of ROIs and hence the scale of the graph. As the scale becomes finer and more ROIs are used, graphs become increasingly sparse. Clearly, the results of downstream statistical analyses can be highly dependent on the chosen parcellation. To solve this problem, we propose a multi-scale graph factorization, which links together scale-specific factorizations through a common set of individual-specific scores. These scores summarize an individual's brain structure combining information across measurement scales. We obtain a simple and efficient algorithm for implementation, and illustrate substantial advantages over single scale approaches in simulations and analyses of the Human Connectome Project dataset.


title: Ionized gas in the NGC 3077 galaxy

abstract: The nearby dwarf galaxy NGC 3077 is known for its peculiar morphology, which includes numerous dust lanes and emission-line regions. The interstellar medium in this galaxy is subject to several perturbing factors. These are primarily the central starburst and tidal structures in the M 81 group. We present a comprehensive study of the state of ionization, kinematics, and chemical composition of ionized gas in NGC 3077, including both star-forming regions and diffuse ionized gas (DIG) at the periphery. We study gas motions in the H$\alpha$ line via high-resolution ($R\approx15\,000$) 3D spectroscopy with the scanning Fabry-Perot interferometer installed into SCORPIO-2 instrument attached to the 6-m telescope of the SAO RAS. Images in the main optical emission lines were acquired with MaNGaL photometer with a tunable filter at the 2.5-m telescope of the Caucasian Mountain Observatory of SAI MSU. We also used SCORPIO-2 to perform long-slit spectroscopy of the galaxy with a resolution of $R\approx1\,000$. Our estimate of the gas metallicity, $Z=0.6Z_\odot$, is significantly lower than the earlier determination, but agrees with the "luminosity--metallicity" dependence. Spatially resolved diagnostic diagrams of the emission-line ratios do not show correlations between the gas ionization state and its velocity dispersion, and this is most likely due to strong ionization by young stars, whereas the contribution of shocks to the excitation of emission lines is less important. We also studied the locations of multicomponent H$\alpha$ profiles and provide arguments suggesting that they are mostly associated with individual kinematic components along the line of sight and not with expanding shells as it was believed earlier. We also observe there a combination of wind outflow from star-forming regions and accretion from interstellar gas clouds in the M 81 group.


title: The heterodyne sensing system for the ALPS II search for sub-eV weakly interacting particles

abstract: ALPS II, the Any Light Particle Search, is a second-generation Light Shining through a Wall experiment that hunts for axion-like particles. The experiment is currently transitioning from the design and construction phase to the commissioning phase, with science runs expected to start in 2021. ALPS II plans to use two different sensing schemes to confirm the potential detection of axion-like particles or to verify an upper limit on their coupling strength to two photons of $g_{a\gamma\gamma}\leq2\times10^{-11}\text{GeV}^{-1}$. This paper discusses a heterodyne sensing scheme (HET) which will be the first scheme deployed to detect the regenerated light. It presents critical details of the optical layout, the length and alignment sensing scheme, design features to minimize spurious signals from stray light, as well as several control and veto channels specific to HET which are needed to commission and operate the instrument and to calibrate the detector sensitivity.


title: A Relativistic Paradox and its Resolution or Who drives the entropy current between two bodies in relative motion?

abstract: We discuss a paradox from the field of relativistic thermodynamics: Two heat reservoirs of the same proper temperature move against each other. One is at rest in reference frame SA, the other in reference frame SB. For an observer, no matter in which of the two reference frames he is at rest, the temperatures of the two reservoirs are different. One might therefore conclude that a thermal engine can be operated between the reservoirs. However, the observers in SA and SB do not agree upon the direction of the entropy flow: from SA to SB, or from SB to SA. The resolution of the paradox is obtained by taking into account that the drive of an entropy current is not simply a temperature difference, but the difference of a quantity that depends on temperature and on velocity.


title: Aspects of arbitrarily oriented dipoles scattering in plane: short-range interaction influence

abstract: The impact of the short-range interaction on the resonances occurrence in the anisotropic dipolar scattering in a plane was numerically investigated for the arbitrarily oriented dipoles and for a wide range of collision energies. We revealed the strong dependence of the cross section of the 2D dipolar scattering on the radius of short-range interaction, which is modeled by a hard wall potential and by the more realistic Lennard-Jones potential, and on the mutual orientations of the dipoles. We defined the critical (magic) tilt angle of one of the dipoles, depending on the direction of the second dipole for arbitrarily oriented dipoles. It was found that resonances arise only when this angle is exceeded. In contrast to the 3D case, the energy dependencies of the boson (fermion) 2D scattering cross section grows (is reduced) with an energy decrease in the absence of the resonances. We showed that the mutual orientation of dipoles strongly impacts the form of the energy dependencies, which begin to oscillate with the tilt angle increase, unlike the 3D dipolar scattering. The angular distributions of the differential cross section in the 2D dipolar scattering of both bosons and fermions are highly anisotropic at non-resonant points. The results of the accurate numerical calculations of the cross section agree well with the results obtained within the Born and eikonal approximations.


title: Neutron Spectroscopy for Pulsed Beams with Frame Overlap using a Double Time-of-Flight Technique

abstract: A new double time-of-flight (dTOF) neutron spectroscopy technique has been developed for pulsed broad spectrum sources with a duty cycle that results in frame overlap, where fast neutrons from a given pulse overtake slower neutrons from previous pulses. Using a tunable beam at the 88-Inch Cyclotron at Lawrence Berkeley National Laboratory, neutrons were produced via thick-target breakup of 16 MeV deuterons on a beryllium target in the cyclotron vault. The breakup spectral shape was deduced from a dTOF measurement using an array of EJ-309 organic liquid scintillators. Simulation of the neutron detection efficiency of the scintillator array was performed using both GEANT4 and MCNP6. The efficiency-corrected spectral shape was normalized using a foil activation technique to obtain the energy-dependent flux of the neutron beam at zero degrees with respect to the incoming deuteron beam. The dTOF neutron spectrum was compared to spectra obtained using HEPROW and GRAVEL pulse height spectrum unfolding techniques. While the unfolding and dTOF results exhibit some discrepancies in shape, the integrated flux values agree within two standard deviations. This method obviates neutron time-of-flight spectroscopy challenges posed by pulsed beams with frame overlap and opens new opportunities for pulsed white neutron source facilities.


title: CAT-Gen: Improving Robustness in NLP Models via Controlled Adversarial Text Generation

abstract: NLP models are shown to suffer from robustness issues, i.e., a model's prediction can be easily changed under small perturbations to the input. In this work, we present a Controlled Adversarial Text Generation (CAT-Gen) model that, given an input text, generates adversarial texts through controllable attributes that are known to be invariant to task labels. For example, in order to attack a model for sentiment classification over product reviews, we can use the product categories as the controllable attribute which would not change the sentiment of the reviews. Experiments on real-world NLP datasets demonstrate that our method can generate more diverse and fluent adversarial texts, compared to many existing adversarial text generation approaches. We further use our generated adversarial examples to improve models through adversarial training, and we demonstrate that our generated attacks are more robust against model re-training and different model architectures.


title: We Don't Speak the Same Language: Interpreting Polarization through Machine Translation

abstract: Polarization among US political parties, media and elites is a widely studied topic. Prominent lines of prior research across multiple disciplines have observed and analyzed growing polarization in social media. In this paper, we present a new methodology that offers a fresh perspective on interpreting polarization through the lens of machine translation. With a novel proposition that two sub-communities are speaking in two different \emph{languages}, we demonstrate that modern machine translation methods can provide a simple yet powerful and interpretable framework to understand the differences between two (or more) large-scale social media discussion data sets at the granularity of words. Via a substantial corpus of 86.6 million comments by 6.5 million users on over 200,000 news videos hosted by YouTube channels of four prominent US news networks, we demonstrate that simple word-level and phrase-level translation pairs can reveal deep insights into the current political divide -- what is \emph{black lives matter} to one can be \emph{all lives matter} to the other.


title: Complexity Analysis of Tree Share Structure

abstract: The tree share structure proposed by Dockins et al. is an elegant model for tracking disjoint ownership in concurrent separation logic, but decision procedures for tree shares are hard to implement due to a lack of a systematic theoretical study. We show that the first-order theory of the full Boolean algebra of tree shares (that is, with all tree-share constants) is decidable and has the same complexity as of the first-order theory of Countable Atomless Boolean Algebras. We prove that combining this additive structure with a constant-restricted unary multiplicative "relativization" operator has a non-elementary lower bound. We examine the consequences of this lower bound and prove that it comes from the combination of both theories by proving an upper bound on a generalization of the restricted multiplicative theory in isolation.


title: Well-Totally-Dominated Graphs

abstract: A subset of vertices in a graph is called a total dominating set if every vertex of the graph is adjacent to at least one vertex of this set. A total dominating set is called minimal if it does not properly contain another total dominating set. In this paper, we study graphs whose all minimal total dominating sets have the same size, referred to as well-totally-dominated (WTD) graphs. We first show that WTD graphs with bounded total domination number can be recognized in polynomial time. Then we focus on WTD graphs with total domination number two. In this case, we characterize triangle-free WTD graphs and WTD graphs with packing number two, and we show that there are only finitely many planar WTD graphs with minimum degree at least three. Lastly, we show that if the minimum degree is at least three then the girth of a WTD graph is at most 12. We conclude with several open questions.


title: Directivity modulation of exciton emission using single dielectric nanospheres

abstract: Coupling emitters with nanoresonators is an effective strategy to control light emission at the subwavelength scale with high efficiency. Low-loss dielectric nanoantennas hold particular promise for this purpose, owing to their strong Mie resonances. Herein, we explore a highly miniaturized platform for the control of emission based on individual subwavelength Si nanospheres (SiNSs) to modulate the directional excitation and exciton emission of two-dimensional transition metal dichalcogenides (2D TMDs). A modified Mie theory for dipole-sphere hybrid systems is derived to instruct the optimal design for desirable modulation performance. Controllable forward-to-backward intensity ratios are experimentally validated in 532 nm laser excitation and 635 nm exciton emission from a monolayer WS2. Versatile light emission control along all device orientations is achieved for different emitters and excitation wavelengths, benefiting from the facile size control and isotropic shape of SiNSs. Simultaneous modulation of excitation and emission via a single SiNS at visible wavelengths significantly improves the efficiency and directivity of TMD exciton emission and leads to the potential of multifunctional integrated photonics. Overall, our work opens promising opportunities for nanophotonics and polaritonic systems, enabling efficient manipulation, enhancement and reconfigurability of light-matter interactions.


title: Multi-level Feature Learning on Embedding Layer of Convolutional Autoencoders and Deep Inverse Feature Learning for Image Clustering

abstract: This paper introduces Multi-Level feature learning alongside the Embedding layer of Convolutional Autoencoder (CAE-MLE) as a novel approach in deep clustering. We use agglomerative clustering as the multi-level feature learning that provides a hierarchical structure on the latent feature space. It is shown that applying multi-level feature learning considerably improves the basic deep convolutional embedding clustering (DCEC). CAE-MLE considers the clustering loss of agglomerative clustering simultaneously alongside the learning latent feature of CAE. In the following of the previous works in inverse feature learning, we show that the representation of learning of error as a general strategy can be applied on different deep clustering approaches and it leads to promising results. We develop deep inverse feature learning (deep IFL) on CAE-MLE as a novel approach that leads to the state-of-the-art results among the same category methods. The experimental results show that the CAE-MLE improves the results of the basic method, DCEC, around 7% -14% on two well-known datasets of MNIST and USPS. Also, it is shown that the proposed deep IFL improves the primary results about 9%-17%. Therefore, both proposed approaches of CAE-MLE and deep IFL based on CAE-MLE can lead to notable performance improvement in comparison to the majority of existing techniques. The proposed approaches while are based on a basic convolutional autoencoder lead to outstanding results even in comparison to variational autoencoders or generative adversarial networks.


title: Tight bounds on the mutual coherence of sensing matrices for Wigner D-functions on regular grids

abstract: Many practical sampling patterns for function approximation on the rotation group utilizes regular samples on the parameter axes. In this paper, we relate the mutual coherence analysis for sensing matrices that correspond to a class of regular patterns to angular momentum analysis in quantum mechanics and provide simple lower bounds for it. The products of Wigner d-functions, which appear in coherence analysis, arise in angular momentum analysis in quantum mechanics. We first represent the product as a linear combination of a single Wigner d-function and angular momentum coefficients, otherwise known as the Wigner 3j symbols. Using combinatorial identities, we show that under certain conditions on the bandwidth and number of samples, the inner product of the columns of the sensing matrix at zero orders, which is equal to the inner product of two Legendre polynomials, dominates the mutual coherence term and fixes a lower bound for it. In other words, for a class of regular sampling patterns, we provide a lower bound for the inner product of the columns of the sensing matrix that can be analytically computed. We verify numerically our theoretical results and show that the lower bound for the mutual coherence is larger than Welch bound. Besides, we provide algorithms that can achieve the lower bound for spherical harmonics.


title: Deep Generative Modelling of Human Reach-and-Place Action

abstract: The motion of picking up and placing an object in 3D space is full of subtle detail. Typically these motions are formed from the same constraints, optimizing for swiftness, energy efficiency, as well as physiological limits. Yet, even for identical goals, the motion realized is always subject to natural variation. To capture these aspects computationally, we suggest a deep generative model for human reach-and-place action, conditioned on a start and end position.We have captured a dataset of 600 such human 3D actions, to sample the 2x3-D space of 3D source and targets. While temporal variation is often modeled with complex learning machinery like recurrent neural networks or networks with memory or attention, we here demonstrate a much simpler approach that is convolutional in time and makes use of(periodic) temporal encoding. Provided a latent code and conditioned on start and end position, the model generates a complete 3D character motion in linear time as a sequence of convolutions. Our evaluation includes several ablations, analysis of generative diversity and applications.


title: A Design-Based Model of the Aortic Valve for Fluid-Structure Interaction

abstract: This paper presents a new method for modeling the mechanics of the aortic valve, and simulates its interaction with blood. As much as possible, the model construction is based on first principles, but such that the model is consistent with experimental observations. We require that tension in the leaflets must support a pressure, then derive a system of partial differential equations governing its mechanical equilibrium. The solution to these differential equations is referred to as the predicted loaded configuration; it includes the loaded leaflet geometry, fiber orientations and tensions needed to support the prescribed load. From this configuration, we derive a reference configuration and constitutive law. In fluid-structure interaction simulations with the immersed boundary method, the model seals reliably under physiological pressures, and opens freely over multiple cardiac cycles. Further, model closure is robust to extreme hypo- and hypertensive pressures. Then, exploiting the unique features of this model construction, we conduct experiments on reference configurations, constitutive laws, and gross morphology. These experiments suggest the following conclusions, which are directly applicable to the design of prosthetic aortic valves. (i) The loaded geometry, tensions and tangent moduli primarily determine model function. (ii) Alterations to the reference configuration have little effect if the predicted loaded configuration is identical. (iii) The leaflets must have sufficiently nonlinear material response to function over a variety of pressures. (iv) Valve performance is highly sensitive to free edge length and leaflet height. For future use, our aortic valve modeling framework offers flexibility in patient-specific models of cardiac flow.


title: Learning with Instance-Dependent Label Noise: A Sample Sieve Approach

abstract: Human-annotated labels are often prone to noise, and the presence of such noise will degrade the performance of the resulting deep neural network (DNN) models. Much of the literature (with several recent exceptions) of learning with noisy labels focuses on the case when the label noise is independent of features. Practically, annotations errors tend to be instance-dependent and often depend on the difficulty levels of recognizing a certain task. Applying existing results from instance-independent settings would require a significant amount of estimation of noise rates. Therefore, providing theoretically rigorous solutions for learning with instance-dependent label noise remains a challenge. In this paper, we propose CORES$^{2}$ (COnfidence REgularized Sample Sieve), which progressively sieves out corrupted examples. The implementation of CORES$^{2}$ does not require specifying noise rates and yet we are able to provide theoretical guarantees of CORES$^{2}$ in filtering out the corrupted examples. This high-quality sample sieve allows us to treat clean examples and the corrupted ones separately in training a DNN solution, and such a separation is shown to be advantageous in the instance-dependent noise setting. We demonstrate the performance of CORES$^{2}$ on CIFAR10 and CIFAR100 datasets with synthetic instance-dependent label noise and Clothing1M with real-world human noise. As of independent interests, our sample sieve provides a generic machinery for anatomizing noisy datasets and provides a flexible interface for various robust training techniques to further improve the performance. Code is available at https://github.com/UCSC-REAL/cores.


title: An Easy-to-Use-and-Deploy Grid Computing Framework

abstract: A few grid-computing tools are available for public use. However, such systems are usually quite complex and require several man-months to set up. In case the user wishes to set-up an ad-hoc grid in a small span of time, such tools cannot be used. Moreover, the complex services they provide, like, reliable file transfer, extra layers of security etc., act as an overhead to performance in case the network is small and reliable. In this paper we describe the structure of our grid-computing framework, which can be implemented and used, easily on a moderate sized network.


title: Singular hyperbolic attractors are statistical stable

abstract: We prove that the unique SRB measure for a singular hyperbolic attractor depends continuously on the dynamics in the weak$^\ast$ topology.


title: Winning Lottery Tickets in Deep Generative Models

abstract: The lottery ticket hypothesis suggests that sparse, sub-networks of a given neural network, if initialized properly, can be trained to reach comparable or even better performance to that of the original network. Prior works in lottery tickets have primarily focused on the supervised learning setup, with several papers proposing effective ways of finding "winning tickets" in classification problems. In this paper, we confirm the existence of winning tickets in deep generative models such as GANs and VAEs. We show that the popular iterative magnitude pruning approach (with late rewinding) can be used with generative losses to find the winning tickets. This approach effectively yields tickets with sparsity up to 99% for AutoEncoders, 93% for VAEs and 89% for GANs on CIFAR and Celeb-A datasets. We also demonstrate the transferability of winning tickets across different generative models (GANs and VAEs) sharing the same architecture, suggesting that winning tickets have inductive biases that could help train a wide range of deep generative models. Furthermore, we show the practical benefits of lottery tickets in generative models by detecting tickets at very early stages in training called "early-bird tickets". Through early-bird tickets, we can achieve up to 88% reduction in floating-point operations (FLOPs) and 54% reduction in training time, making it possible to train large-scale generative models over tight resource constraints. These results out-perform existing early pruning methods like SNIP (Lee, Ajanthan, and Torr 2019) and GraSP (Wang, Zhang, and Grosse 2020). Our findings shed light towards existence of proper network initializations that could improve convergence and stability of generative models.


title: Eta Carinae & the Homunculus: Far Infrared, Sub-millimeter Spectral Lines

abstract: The evolved massive binary star Eta Carinae underwent eruptive mass loss events that formed the complex bi-polar Homunculus nebula harboring tens of solar masses of unusually nitrogen-rich gas and dust. Despite expectations for the presence of a significant molecular component to the gas, detections have been observationally challenged by limited access to the far-infrared and the intense thermal continuum. A spectral survey of the atomic and rotational molecular transitions was carried out with the Herschel Space Observatory, revealing a rich spectrum of broad emission lines originating in the ejecta. Velocity profiles of selected PACS lines correlate well with known substructures: H I in the central core; NH and weak [C II] within the Homunculus; and [N II] emissions in fast-moving structures external to the Homunculus. We have identified transitions from [O I], H I, and 18 separate light C- and O-bearing molecules including CO, CH, CH+, and OH, and a wide set of N-bearing molecules, NH, NH+, N2H+, NH2, NH3, HCN, HNC, CN, and N2H+. Half of these are new detections unprecedented for any early-type massive star environment. A very low ratio [12C/13C] LE 4 is estimated from five molecules and their isotopologues. We demonstrate that non-LTE effects due to the strong continuum are significant. Abundance patterns are consistent with line formation in regions of carbon and oxygen depletions with nitrogen enhancements, reflecting an evolved state of the erupting star with efficient transport of CNO-processed material to the outer layers. The results offer many opportunities for further observational and theoretical investigations of the molecular chemistry under extreme physical and chemical conditions around massive stars in their final stages of evolution.


title: Inference Strategies for Machine Translation with Conditional Masking

abstract: Conditional masked language model (CMLM) training has proven successful for non-autoregressive and semi-autoregressive sequence generation tasks, such as machine translation. Given a trained CMLM, however, it is not clear what the best inference strategy is. We formulate masked inference as a factorization of conditional probabilities of partial sequences, show that this does not harm performance, and investigate a number of simple heuristics motivated by this perspective. We identify a thresholding strategy that has advantages over the standard "mask-predict" algorithm, and provide analyses of its behavior on machine translation tasks.


title: Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages

abstract: Research in NLP lacks geographic diversity, and the question of how NLP can be scaled to low-resourced languages has not yet been adequately solved. "Low-resourced"-ness is a complex problem going beyond data availability and reflects systemic problems in society. In this paper, we focus on the task of Machine Translation (MT), that plays a crucial role for information accessibility and communication worldwide. Despite immense improvements in MT over the past decade, MT is centered around a few high-resourced languages. As MT researchers cannot solve the problem of low-resourcedness alone, we propose participatory research as a means to involve all necessary agents required in the MT development process. We demonstrate the feasibility and scalability of participatory research with a case study on MT for African languages. Its implementation leads to a collection of novel translation datasets, MT benchmarks for over 30 languages, with human evaluations for a third of them, and enables participants without formal training to make a unique scientific contribution. Benchmarks, models, data, code, and evaluation results are released under https://github.com/masakhane-io/masakhane-mt.


title: The Traveling Observer Model: Multi-task Learning Through Spatial Variable Embeddings

abstract: This paper frames a general prediction system as an observer traveling around a continuous space, measuring values at some locations, and predicting them at others. The observer is completely agnostic about any particular task being solved; it cares only about measurement locations and their values. This perspective leads to a machine learning framework in which seemingly unrelated tasks can be solved by a single model, by embedding their input and output variables into a shared space. An implementation of the framework is developed in which these variable embeddings are learned jointly with internal model parameters. In experiments, the approach is shown to (1) recover intuitive locations of variables in space and time, (2) exploit regularities across related datasets with completely disjoint input and output spaces, and (3) exploit regularities across seemingly unrelated tasks, outperforming task-specific single-task models and multi-task learning alternatives. The results suggest that even seemingly unrelated tasks may originate from similar underlying processes, a fact that the traveling observer model can use to make better predictions.


title: A Levine-Tristram invariant for knotted tori

abstract: Echeverria recently introduced an invariant for a smoothly embedded torus in a homology $S^1\times S^3$, using gauge theory for singular connections. We define a new topological invariant of such an embedded torus, analogous to the classical Levine-Tristram invariant of a knot. In the 3-dimensional situation, a count of singular connections on a knot complement reproduces the Levine-Tristram invariant. We compute the invariant for a number of examples embedded tori, and show that our topological invariant is the same as what one might expect from Echeverria's invariant. Langte Ma has subsequently shown this in general.


title: Breakdown of Ergodicity and Self-Averaging in Polar Flocks with Quenched Disorder

abstract: We show that spatial quenched disorder affects polar active matter in ways more complex and far-reaching than believed heretofore. Using simulations of the 2D Vicsek model subjected to random couplings or a disordered scattering field, we find in particular that ergodicity is lost in the ordered phase, the nature of which we show to depend qualitatively on the type of quenched disorder: for random couplings, it remains long-range ordered, but qualitatively different from the pure (disorderless) case. For random scatterers, polar order varies with system size but we find strong non-self-averaging, with sample-to-sample fluctuations dominating asymptotically, which prevents us from elucidating the asymptotic status of order.


title: Understanding the Mechanics of SPIGOT: Surrogate Gradients for Latent Structure Learning

abstract: Latent structure models are a powerful tool for modeling language data: they can mitigate the error propagation and annotation bottleneck in pipeline systems, while simultaneously uncovering linguistic insights about the data. One challenge with end-to-end training of these models is the argmax operation, which has null gradient. In this paper, we focus on surrogate gradients, a popular strategy to deal with this problem. We explore latent structure learning through the angle of pulling back the downstream learning objective. In this paradigm, we discover a principled motivation for both the straight-through estimator (STE) as well as the recently-proposed SPIGOT - a variant of STE for structured models. Our perspective leads to new algorithms in the same family. We empirically compare the known and the novel pulled-back estimators against the popular alternatives, yielding new insight for practitioners and revealing intriguing failure cases.


title: VisualWordGrid: Information Extraction From Scanned Documents Using A Multimodal Approach

abstract: We introduce a novel approach for scanned document representation to perform field extraction. It allows the simultaneous encoding of the textual, visual and layout information in a 3-axis tensor used as an input to a segmentation model. We improve the recent Chargrid and Wordgrid \cite{chargrid} models in several ways, first by taking into account the visual modality, then by boosting its robustness in regards to small datasets while keeping the inference time low. Our approach is tested on public and private document-image datasets, showing higher performances compared to the recent state-of-the-art methods.


title: A Concentration-Time Hybrid Modulation Scheme for Molecular Communications

abstract: Significant inter-symbol interference (ISI) challenges the achievement of reliable, high data-rate molecular communication via diffusion. In this paper, a hybrid modulation based on pulse position and concentration is proposed to mitigate ISI. By exploiting the time dimension, molecular concentration and position modulation (MCPM) increases the achievable data rate over conventional concentration and position-based modulations. In addition, unlike multi-molecule schemes, this hybrid scheme employs a single-molecule type and so simplifies transceiver implementations. In the paper, the optimal sequence detector of the proposed modulation is provided as well as a reduced complexity detector (two-stage, position-concentration detector, TPCD). A tractable cost function based on the TPCD detector is proposed and employed to optimize the design of the hybrid modulation scheme. In addition, the approximate probability of error for the MCPM-TPCD system is derived and is shown to be tight with respect to simulated performance. Numerically, MCPM shows improved performance over standard concentration and pulse position-based schemes in the low transmission power and high bit-rate regime. Furthermore, MCPM offers increased robustness against synchronization errors.


title: An overview of epidemic models with phase transitions to absorbing states running on top of complex networks

abstract: Dynamical systems running on the top of complex networks has been extensively investigated for decades. But this topic still remains among the most relevant issues in complex network theory due to its range of applicability. The contact process (CP) and the susceptible-infected-susceptible (SIS) model are used quite often to describe epidemic dynamics. Despite their simplicity, these models are robust to predict the kernel of real situations. In this work, we review concisely both processes that are well-known and very applied examples of models that exhibit absorbing-state phase transitions. In the epidemic scenario, individuals can be infected or susceptible. A phase transition between a disease-free (absorbing) state and an active stationary phase (where a fraction of the population is infected) are separated by an epidemic threshold. For the SIS model, the central issue is to determine this epidemic threshold on heterogeneous networks. For the CP model, the main interest is to relate critical exponents with statistical properties of the network.


title: Performance Analysis of Traditional and Data-Parallel Primitive Implementations of Visualization and Analysis Kernels

abstract: Measurements of absolute runtime are useful as a summary of performance when studying parallel visualization and analysis methods on computational platforms of increasing concurrency and complexity. We can obtain even more insights by measuring and examining more detailed measures from hardware performance counters, such as the number of instructions executed by an algorithm implemented in a particular way, the amount of data moved to/from memory, memory hierarchy utilization levels via cache hit/miss ratios, and so forth. This work focuses on performance analysis on modern multi-core platforms of three different visualization and analysis kernels that are implemented in different ways: one is "traditional", using combinations of C++ and VTK, and the other uses a data-parallel approach using VTK-m. Our performance study consists of measurement and reporting of several different hardware performance counters on two different multi-core CPU platforms. The results reveal interesting performance differences between these two different approaches for implementing these kernels, results that would not be apparent using runtime as the only metric.


title: Critical thresholds in a nonlocal Euler system with relaxation

abstract: We propose and study a nonlocal Euler system with relaxation, which tends to a strictly hyperbolic system under the hyperbolic scaling limit. An independent proof of the local existence and uniqueness of this system is presented in any spatial dimension. We further derive a precise critical threshold for this system in one dimensional setting. Our result reveals that such nonlocal system admits global smooth solutions for a large class of initial data. Thus, the nonlocal velocity regularizes the generic finite-time breakdown in the pressureless Euler system.


title: Learning to Localise Automated Vehicles in Challenging Environments using Inertial Navigation Systems (INS)

abstract: An algorithm based on Artificial Neural Networks is proposed in this paper to improve the accuracy of Inertial Navigation System (INS)/ Global Navigation Satellite System (GNSS) integrated navigation during the absence of GNSS signals. The INS which can be used to continuously position autonomous vehicles during GNSS signal losses around urban canyons, bridges, tunnels and trees, suffers from unbounded exponential error drifts cascaded over time during the integration of the gyroscope and double integration of the accelerometer to displacement. More so, the error drift is characterised by a pattern dependent on time. The Input Delay Neural Network (IDNN) has the ability to learn the error drift over time [1] and possesses the quality of being more computationally efficient than the Recurrent Neural Network (RNN), Long Short-Term Memory, and the Gated Recurrent Unit Network. Furthermore published literatures focus on travel routes which do not take complex driving scenarios into consideration, we therefore investigate in this paper the performance of the proposed algorithm on challenging scenarios, such as hard brake, roundabouts, sharp cornering, successive left and right turns and quick changes in vehicular acceleration across numerous test sequences. The results obtained show that the Neural Network-based approaches are able to provide up to 89.55 % improvement on the INS displacement estimation and 93.35 % on the INS orientation rate estimation.


title: Understanding Classifier Mistakes with Generative Models

abstract: Although deep neural networks are effective on supervised learning tasks, they have been shown to be brittle. They are prone to overfitting on their training distribution and are easily fooled by small adversarial perturbations. In this paper, we leverage generative models to identify and characterize instances where classifiers fail to generalize. We propose a generative model of the features extracted by a classifier, and show using rigorous hypothesis testing that errors tend to occur when features are assigned low-probability by our model. From this observation, we develop a detection criteria for samples on which a classifier is likely to fail at test time. In particular, we test against three different sources of classification failures: mistakes made on the test set due to poor model generalization, adversarial samples and out-of-distribution samples. Our approach is agnostic to class labels from the training set which makes it applicable to models trained in a semi-supervised way.


title: A Note on Surgical Eigenstructure Assignment via State Feedback

abstract: Assignability of all eigenvalues and a subset of key eigenvectors/generalized eigenvectors of a linear time-invariant system via state feedback is considered. We clarify that, if the key eigenvectors/generalized eigenvectors and their associated eigenvalues satisfy the classical conditions for full eigenstructure assignment, the remaining eigenvalues can be assigned at will.


title: On the relative role of the physical mechanisms on complex biodamage induced by carbon irradiation

abstract: The effective use of swift ion beams in cancer treatment (known as hadrontherapy) as well as an appropriate protection in manned space missions rely on the accurate understanding of energy delivery to cells damaging their genetic information. The key ingredient characterizing the response of a medium to the perturbation induced by charged particles is its electronic excitation spectrum. By using linear response time-dependent density functional theory, we obtain the energy and momentum transfer excitation spectrum (the energy-loss function, ELF) of liquid water (main constituent of biological tissues), in excellent agreement with experimental data. The inelastic scattering cross sections obtained from this ELF, together with the elastic scattering cross sections derived considering the condensed phase nature of the medium, are used to perform accurate Monte Carlo simulations of the energy deposited by swift carbon ions in liquid water and carried away by the generated secondary electrons producing inelastic events (ionization, excitation, and dissociation electron attachment, DEA), strongly correlated with cellular death, which are scored in sensitive volumes having the size of two DNA convolutions. The sizes of clusters of damaging events for a wide range of carbon ion energies, from those relevant to hadrontherapy up to cosmic radiation, predict with unprecedented statistical accuracy the nature and relative magnitude of the main inelastic processes contributing to radiation biodamage, confirming that ionization accounts for the vast majority of complex damage. DEA, typically regarded as a very relevant biodamage mechanism, surprisingly plays a minor role in carbon-ion induced clusters of harmful events.


title: Automotive Radar Data Acquisition using Object Detection

abstract: The growing urban complexity demands an efficient algorithm to acquire and process various sensor information from autonomous vehicles. In this paper, we introduce an algorithm to utilize object detection results from the image to adaptively sample and acquire radar data using Compressed Sensing (CS). This novel algorithm is motivated by the hypothesis that with a limited sampling budget, allocating more sampling budget to areas with the object as opposed to a uniform sampling ultimately improves relevant object detection performance. We improve detection performance by dynamically allocating a lower sampling rate to objects such as buses than pedestrians leading to better reconstruction than baseline across areas with objects of interest. We automate the sampling rate allocation using linear programming and show significant time savings while reducing the radar block size by a factor of 2. We also analyze a Binary Permuted Diagonal measurement matrix for radar acquisition which is hardware-efficient and show its performance is similar to Gaussian and Binary Permuted Block Diagonal matrix. Our experiments on the Oxford radar dataset show an effective reconstruction of objects of interest with 10% sampling rate. Finally, we develop a transformer-based 2D object detection network using the NuScenes radar and image data.


title: Complex network model for COVID-19: human behavior, pseudo-periodic solutions and multiple epidemic waves

abstract: We propose a mathematical model for the transmission dynamics of SARS-CoV-2 in a homogeneously mixing non constant population, and generalize it to a model where the parameters are given by piecewise constant functions. This allows us to model the human behavior and the impact of public health policies on the dynamics of the curve of active infected individuals during a COVID-19 epidemic outbreak. After proving the existence and global asymptotic stability of the disease-free and endemic equilibrium points of the model with constant parameters, we consider a family of Cauchy problems, with piecewise constant parameters, and prove the existence of pseudo-oscillations between a neighborhood of the disease-free equilibrium and a neighborhood of the endemic equilibrium, in a biologically feasible region. In the context of the COVID-19 pandemic, this pseudo-periodic solutions are related to the emergence of epidemic waves. Then, to capture the impact of mobility in the dynamics of COVID-19 epidemics, we propose a complex network with six distinct regions based on COVID-19 real data from Portugal. We perform numerical simulations for the complex network model, where the objective is to determine a topology that minimizes the level of active infected individuals and the existence of topologies that are likely to worsen the level of infection. We claim that this methodology is a tool with enormous potential in the current pandemic context, and can be applied in the management of outbreaks (in regional terms) but also to manage the opening/closing of borders.


title: A Reinforcement Learning Approach for Rebalancing Electric Vehicle Sharing Systems

abstract: This paper proposes a reinforcement learning approach for nightly offline rebalancing operations in free-floating electric vehicle sharing systems (FFEVSS). Due to sparse demand in a network, FFEVSS require relocation of electrical vehicles (EVs) to charging stations and demander nodes, which is typically done by a group of drivers. A shuttle is used to pick up and drop off drivers throughout the network. The objective of this study is to solve the shuttle routing problem to finish the rebalancing work in the minimal time. We consider a reinforcement learning framework for the problem, in which a central controller determines the routing policies of a fleet of multiple shuttles. We deploy a policy gradient method for training recurrent neural networks and compare the obtained policy results with heuristic solutions. Our numerical studies show that unlike the existing solutions in the literature, the proposed methods allow to solve the general version of the problem with no restrictions on the urban EV network structure and charging requirements of EVs. Moreover, the learned policies offer a wide range of flexibility resulting in a significant reduction in the time needed to rebalance the network.


title: Prediction of Solar Cycle 25

abstract: Prediction of solar cycle is an important goal of Solar Physics both because it serves as a touchstone for our understanding of the sun and also because of its societal value for a space faring civilization. The task is difficult and progress is slow. Schatten et al. (1978) suggested that the magnitude of the magnetic field in the polar regions of the sun near solar minimum could serve as a precursor for the evolution and amplitude of the following solar cycle. Since then, this idea has been the foundation of somewhat successful predictions of the size of the last four cycles, especially of the unexpectedly weak solar cycle 24 ("the weakest in 100 years"). Direct measurements of the polar magnetic fields are available since the 1970s and we have just passed the solar minimum prior to solar cycle 25, so a further test of the polar field precursor method is now possible. The predicted size of the new cycle 25 is 128$\pm$10 (on the new sunspot number version 2 scale), slightly larger than the previous cycle.


title: Computational frameworks for homogenization and multiscale stability analyses of nonlinear periodic metamaterials

abstract: This paper presents a consistent computational framework for multiscale 1st order finite strain homogenization and stability analyses of rate-independent solids with periodic microstructures. Based on the principle of multiscale virtual power, the homogenization formulation is built on a priori discretized microstructure, and algorithms for computing the matrix representations of the homogenized stresses and tangent moduli are consistently derived. The homogenization results lose their validity at the onset of 1st bifurcation, which can be computed from multiscale stability analysis. The multiscale instabilities include: a) microscale structural instability which is calculated by Bloch wave analysis; and b) macroscale material instability which is calculated by rank-1 convexity checks on the homogenized tangent moduli. Details on the implementation of the Bloch wave analysis are provided, including the selection of the wave vector space and the retrieval of the real-valued buckling mode from the complex-valued Bloch wave. Three methods are detailed for solving the resulted constrained eigenvalue problem - two condensation methods and a null-space based projection method. Both implementations of the homogenization and stability analyses are validated using numerical examples including hyperelastic and elastoplastic metamaterials. Various microscale buckling phenomena are also demonstrated by examining several representative metamaterial examples. Aligned with theoretical results, the numerical results show that the microscopic long wavelength buckling can be equivalently detected by the loss of rank-1 convexity of the homogenized tangent moduli.


title: Lower Bounds and Optimal Algorithms for Personalized Federated Learning

abstract: In this work, we consider the optimization formulation of personalized federated learning recently introduced by Hanzely and Richt\'arik (2020) which was shown to give an alternative explanation to the workings of local {\tt SGD} methods. Our first contribution is establishing the first lower bounds for this formulation, for both the communication complexity and the local oracle complexity. Our second contribution is the design of several optimal methods matching these lower bounds in almost all regimes. These are the first provably optimal methods for personalized federated learning. Our optimal methods include an accelerated variant of {\tt FedProx}, and an accelerated variance-reduced version of {\tt FedAvg}/Local {\tt SGD}. We demonstrate the practical superiority of our methods through extensive numerical experiments.


title: Explaining muon $g-2$ anomaly in a non-universal $U(1)_{X}$ extended SUSY theory

abstract: A non-universal $U(1)_{X}$ extension to the Standard Model composed of two scalar doublets and two scalar singlets together with three additional quark singlets and two lepton singlets and three generations of right-handed and Majorana neutrinos is made to explain lepton mass hierarchy, neutrino masses via inverse seesaw mechanism and muon anomalous magnetic moment in an anomaly free framework. In the present model, exotic and Standard Model particles acquire mass thanks to vacuum expectation values at different scales, yet the electron and the lightest neutrino are tree level massless but massive at one-loop level. By considering a numerical exploration and under the constraint of the Higgs mass, neutrino mass differences and PMNS matrix, it is found that only contributions due to exotic neutrinos interacting with charged scalars are relevant to muon $g-2$, though they are negative. Thus, the SUSY extension is considered and it is found that muon $g-2$ can be explained by allowing $U(1)_{X}$ vacuum expectation values to lie in the TeV scale thanks to SUSY soft-breaking interactions for at least $\sim 10^{5}$ GeV masses. Thus, the contribution due to exotic neutrinos interacting with $W$ gauge bosons is positive and no longer negligible which added to all other contributions might explain the anomaly.


title: Global soil moisture from in-situ measurements using machine learning -- SoMo.ml

abstract: While soil moisture information is essential for a wide range of hydrologic and climate applications, spatially-continuous soil moisture data is only available from satellite observations or model simulations. Here we present a global, long-term dataset of soil moisture generated from in-situ measurements using machine learning, SoMo.ml. We train a Long Short-Term Memory (LSTM) model to extrapolate daily soil moisture dynamics in space and in time, based on in-situ data collected from more than 1,000 stations across the globe. SoMo.ml provides multi-layer soil moisture data (0-10 cm, 10-30 cm, and 30-50 cm) at 0.25{\deg} spatial and daily temporal resolution over the period 2000-2019. The performance of the resulting dataset is evaluated through cross validation and inter-comparison with existing soil moisture datasets. SoMo.ml performs especially well in terms of temporal dynamics, making it particularly useful for applications requiring time-varying soil moisture, such as anomaly detection and memory analyses. SoMo.ml complements the existing suite of modelled and satellite-based datasets given its independent and novel derivation, to support large-scale hydrological, meteorological, and ecological analyses.


title: Investigating representations of verb bias in neural language models

abstract: Languages typically provide more than one grammatical construction to express certain types of messages. A speaker's choice of construction is known to depend on multiple factors, including the choice of main verb -- a phenomenon known as \emph{verb bias}. Here we introduce DAIS, a large benchmark dataset containing 50K human judgments for 5K distinct sentence pairs in the English dative alternation. This dataset includes 200 unique verbs and systematically varies the definiteness and length of arguments. We use this dataset, as well as an existing corpus of naturally occurring data, to evaluate how well recent neural language models capture human preferences. Results show that larger models perform better than smaller models, and transformer architectures (e.g. GPT-2) tend to out-perform recurrent architectures (e.g. LSTMs) even under comparable parameter and training settings. Additional analyses of internal feature representations suggest that transformers may better integrate specific lexical information with grammatical constructions.


title: Searching for ZZ Ceti White Dwarfs in the Gaia Survey

abstract: The {\it Gaia} satellite recently released parallax measurements for $\sim$260,000 high-confidence white dwarf candidates, allowing for precise measurements of their physical parameters. By combining these parallaxes with Pan-STARRS and $u$-band photometry, we measured the effective temperature and stellar mass for all white dwarfs in the Northern Hemisphere within 100 parsecs of the Sun, and identified a sample of ZZ Ceti white dwarf candidates within the so-called instability strip. We acquired high-speed photometric observations for 90 candidates using the PESTO camera attached to the 1.6-m telescope at the Mont-M\'egantic Observatory. We report the discovery of 38 new ZZ Ceti stars, including two very rare ultra-massive pulsators. We also identified 5 possibly variable stars within the strip, in addition to 47 objects that do not appear to show any photometric variability. However, several of those could be variable with an amplitude below our detection threshold, or could be located outside the instability strip due to errors in their photometric parameters. In the light of our results, we explore the trends of the dominant period and amplitude in the $M - T_{\rm eff}$ plane, and briefly discuss the question of the purity of the ZZ Ceti instability strip (i.e. a region devoid of non-variable stars).


title: Improving Neural Topic Models using Knowledge Distillation

abstract: Topic models are often used to identify human-interpretable topics to help make sense of large document collections. We use knowledge distillation to combine the best attributes of probabilistic topic models and pretrained transformers. Our modular method can be straightforwardly applied with any neural topic model to improve topic quality, which we demonstrate using two models having disparate architectures, obtaining state-of-the-art topic coherence. We show that our adaptable framework not only improves performance in the aggregate over all estimated topics, as is commonly reported, but also in head-to-head comparisons of aligned topics.


title: Protectionism and economic growth: Causal evidence from the first era of globalization

abstract: We investigate how protectionist policies influence economic growth. Our empirical strategy exploits an extraordinary tax scandal that gave rise to an unexpected change of government in Sweden. A free-trade majority in parliament was overturned by a protectionist majority in 1887. The protectionist government increased tariffs. We employ the synthetic control method to select control countries against which economic growth in Sweden can be compared. We do not find evidence suggesting that protectionist policies influenced economic growth and examine channels why. The new tariff laws increased government revenue. However, the results do not suggest that the protectionist government stimulated the economy by increasing government expenditure.


title: A Parallel Batch-Dynamic Data Structure for the Closest Pair Problem

abstract: We propose a theoretically-efficient and practical parallel batch-dynamic data structure for the closest pair problem. Our solution is based on a serial dynamic closest pair data structure by Golin et al., and supports batches of insertions and deletions in parallel. For a data set of size $n$, our data structure supports a batch of insertions or deletions of size $m$ in $O(m(1+\log ((n+m)/m)))$ expected work and $O(\log (n+m)\log^*(n+m))$ depth with high probability, and takes linear space. The key techniques for achieving these bounds are a new work-efficient parallel batch-dynamic binary heap, and careful management of the computation across sets of points to minimize work and depth. We provide an optimized multicore implementation of our data structure using dynamic hash tables, parallel heaps, and dynamic $k$-d trees. Our experiments on a variety of synthetic and real-world data sets show that it achieves a parallel speedup of up to 38.57x (15.10x on average) on 48 cores with hyper-threading. In addition, we also implement and compare four parallel algorithms for static closest pair problem, for which we are not aware of any existing practical implementations. On 48 cores with hyper-threading, the static algorithms achieve up to 51.45x (29.42x on average) speedup, and Rabin's algorithm performs the best on average. Comparing our dynamic algorithm to the fastest static algorithm, we find that it is advantageous to use the dynamic algorithm for batch sizes of up to 20\% of the data set. As far as we know, our work is the first to experimentally evaluate parallel closest pair algorithms, in both the static and the dynamic settings.


title: Enabling High-Power, Broadband THz Generation with 800-nm Pump Wavelength

abstract: The organic terahertz (THz) generation crystal BNA has recently gained traction as a valuable source to produce broadband THz pulses. Even when pumped with 800-nm light, thin BNA crystals can produce relatively high electric fields with frequency components out to 5 THz. However, the THz output when pumped with 800-nm light is limited by the damage threshold of the organic crystal. Here we report that the damage threshold of BNA can be significantly improved by physically bonding BNA to a high-thermal conductivity sapphire window. When pumped with 800-nm light from an amplified Ti:sapphire laser system, our bonded BNA (BNA-sapphire) generates 2.5 times higher electric field strengths compared to bare BNA crystals. We characterize the average damage threshold for bare BNA and BNA-sapphire, measure peak-to-peak electric field strengths and THz waveforms, and determine the nonlinear transmission in BNA. Pumping BNA-sapphire with 800-nm light results in peak-to-peak electric fields exceeding 1 MV/cm, with strong broadband frequency components from 0.5-5 THz. Our BNA-sapphire THz source is a promising alternative to tilted pulse front LiNbO3 THz sources, which will enable many research groups without optical parametric amplifiers to perform high-field, broadband THz spectroscopy.


title: Cosmogenic activation in double beta decay experiments

abstract: Double beta decay is a very rare nuclear process and, therefore, experiments intended to detect it must be operated deep underground and in ultra-low background conditions. Long-lived radioisotopes produced by the previous exposure of materials to cosmic rays on the Earth's surface or even underground can become problematic for the required sensitivity. Here, the studies developed to quantify and reduce the activation yields in detectors and materials used in the set-up of these experiments will be reviewed, considering target materials like germanium, tellurium and xenon together with other ones commonly used like copper, lead, stainless steel or argon. Calculations following very different approaches and measurements from irradiation experiments using beams or directly cosmic rays will be considered for relevant radioisotopes. The effect of cosmogenic activation in present and future double beta decay projects based on different types of detectors will be analyzed too.

categories: physics.ins-det astro-ph.IM hep-ex nucl-ex


title: Moduli of Distributions via Singular Schemes

abstract: Let $X$ be a smooth projective variety. We show that the map that sends a codimension one distribution on $X$ to its singular scheme is a morphism from the moduli space of distributions into a Hilbert scheme. We describe its fibers and, when $X = \mathbb{P}^n$, compute them via syzygies. As an application, we describe the moduli spaces of degree 1 distributions on $\mathbb{P}^3$. We also give the minimal graded free resolution for the ideal of the singular scheme of a generic distribution on $\mathbb{P}^3$.


title: Randomized Value Functions via Posterior State-Abstraction Sampling

abstract: State abstraction has been an essential tool for dramatically improving the sample efficiency of reinforcement-learning algorithms. Indeed, by exposing and accentuating various types of latent structure within the environment, different classes of state abstraction have enabled improved theoretical guarantees and empirical performance. When dealing with state abstractions that capture structure in the value function, however, a standard assumption is that the true abstraction has been supplied or unrealistically computed a priori, leaving open the question of how to efficiently uncover such latent structure while jointly seeking out optimal behavior. Taking inspiration from the bandit literature, we propose that an agent seeking out latent task structure must explicitly represent and maintain its uncertainty over that structure as part of its overall uncertainty about the environment. We introduce a practical algorithm for doing this using two posterior distributions over state abstractions and abstract-state values. In empirically validating our approach, we find that substantial performance gains lie in the multi-task setting where tasks share a common, low-dimensional representation.


title: Fine-Grained Grounding for Multimodal Speech Recognition

abstract: Multimodal automatic speech recognition systems integrate information from images to improve speech recognition quality, by grounding the speech in the visual context. While visual signals have been shown to be useful for recovering entities that have been masked in the audio, these models should be capable of recovering a broader range of word types. Existing systems rely on global visual features that represent the entire image, but localizing the relevant regions of the image will make it possible to recover a larger set of words, such as adjectives and verbs. In this paper, we propose a model that uses finer-grained visual information from different parts of the image, using automatic object proposals. In experiments on the Flickr8K Audio Captions Corpus, we find that our model improves over approaches that use global visual features, that the proposals enable the model to recover entities and other related words, such as adjectives, and that improvements are due to the model's ability to localize the correct proposals.


title: Power Analysis for Stepped Wedge Trials with Two Treatments

abstract: Stepped wedge designs (SWDs) are designs for cluster randomized trials that feature staggered, unidirectional cross-over, typically from a control to a treatment condition. Existing literature on statistical power for SWDs primarily focuses on designs with a single treatment. However, SWDs with multiple treatments are being proposed and conducted. We present a linear mixed model for a SWD with two treatments, with and without an interaction between them. We derive closed form solutions for the standard errors of the treatment effect coefficients for such models along with power calculation methods. We consider repeated cross-sectional designs as well as open and closed cohort designs and different random effect structures. Design features are examined to determine their impact on power for main treatment and interaction effects.


title: Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learning

abstract: Interactive Fiction (IF) games with real human-written natural language texts provide a new natural evaluation for language understanding techniques. In contrast to previous text games with mostly synthetic texts, IF games pose language understanding challenges on the human-written textual descriptions of diverse and sophisticated game worlds and language generation challenges on the action command generation from less restricted combinatorial space. We take a novel perspective of IF game solving and re-formulate it as Multi-Passage Reading Comprehension (MPRC) tasks. Our approaches utilize the context-query attention mechanisms and the structured prediction in MPRC to efficiently generate and evaluate action outputs and apply an object-centric historical observation retrieval strategy to mitigate the partial observability of the textual observations. Extensive experiments on the recent IF benchmark (Jericho) demonstrate clear advantages of our approaches achieving high winning rates and low data requirements compared to all previous approaches. Our source code is available at: https://github.com/XiaoxiaoGuo/rcdqn.


title: Metadata-Based Detection of Child Sexual Abuse Material

abstract: Child Sexual Abuse Media (CSAM) is any visual record of a sexually-explicit activity involving minors. CSAM impacts victims differently from the actual abuse because the distribution never ends, and images are permanent. Machine learning-based solutions can help law enforcement quickly identify CSAM and block digital distribution. However, collecting CSAM imagery to train machine learning models has many ethical and legal constraints, creating a barrier to research development. With such restrictions in place, the development of CSAM machine learning detection systems based on file metadata uncovers several opportunities. Metadata is not a record of a crime, and it does not have legal restrictions. Therefore, investing in detection systems based on metadata can increase the rate of discovery of CSAM and help thousands of victims. We propose a framework for training and evaluating deployment-ready machine learning models for CSAM identification. Our framework provides guidelines to evaluate CSAM detection models against intelligent adversaries and models' performance with open data. We apply the proposed framework to the problem of CSAM detection based on file paths. In our experiments, the best-performing model is based on convolutional neural networks and achieves an accuracy of 0.97. Our evaluation shows that the CNN model is robust against offenders actively trying to evade detection by evaluating the model against adversarially modified data. Experiments with open datasets confirm that the model generalizes well and is deployment-ready.


title: A Note on Exponential-Time Algorithms for Linearwidth

abstract: In this note, we give an algorithm that computes the linearwidth of input $n$-vertex graphs in time $O^*(2^n)$, which improves a trivial $O^*(2^m)$-time algorithm, where $n$ and $m$ the number of vertices and edges, respectively.


title: Automated Counting of Restricted Motzkin Paths

abstract: Motzkin paths are simple yet important combinatorial objects. In this paper, we consider families of Motzkin paths with restrictions on peak heights, valley heights, upward-run lengths, downward-run lengths, and flat-run lengths. This paper presents two fully automated methods for enumerating the paths of such families. The first method uses numeric dynamic programming. While this method often times works, it can be slow and may not work for larger problems. The second method uses symbolic dynamic programming to solve such problems. These methods are implemented in the maple packages accompanying this article.


title: Measurement of Differential Cross Sections for $\nu_\mu$-Ar Charged-Current Interactions with Protons and no Pions in the Final State with the MicroBooNE Detector

abstract: We present an analysis of MicroBooNE data with a signature of one muon, no pions, and at least one proton above a momentum threshold of 300 MeV/c (CC0$\pi$Np). This is the first differential cross section measurement of this topology in neutrino-argon interactions. We achieve a significantly lower proton momentum threshold than previous carbon and scintillator-based experiments. Using data collected from a total of approximately $1.6 \times 10^{20}$ protons-on-target, we measure the muon neutrino cross section for the CC0$\pi$Np interaction channel in argon at MicroBooNE in the Booster Neutrino Beam which has a mean energy of around 800 MeV. We present the results from a data sample with estimated efficiency of 29\% and purity of 76\% as differential cross sections in five reconstructed variables: the muon momentum and polar angle, the leading proton momentum and polar angle, and the muon-proton opening angle. We include smearing matrices that can be used to "forward-fold" theoretical predictions for comparison with these data. We compare the measured differential cross sections to a number of recent theory predictions demonstrating largely good agreement with this first-ever data set on argon.

categories: hep-ex hep-ph nucl-ex nucl-th physics.ins-det


title: RNA-seq data science: From raw data to effective interpretation

abstract: RNA-sequencing (RNA-seq) has become an exemplar technology in modern biology and clinical applications over the past decade. It has gained immense popularity in the recent years driven by continuous efforts of the bioinformatics community to develop accurate and scalable computational tools. RNA-seq is a method of analyzing the RNA content of a sample using the modern sequencing platforms. It generates enormous amounts of transcriptomic data in the form of nucleotide sequences, known as reads. RNA-seq analysis enables the probing of genes and corresponding transcripts which is essential for answering important biological questions, such as detecting novel exons, transcripts, gene expressions, and studying alternative splicing structure. However, obtaining meaningful biological signals from raw data using computational methods is challenging due to the limitations of modern sequencing technologies. The need to leverage these technological challenges have pushed the rapid development of many novel computational tools which have evolved and diversified in accordance with technological advancements, leading to the current myriad population of RNA-seq tools. Our review provides a systemic overview of RNA-seq technology and 235 available RNA-seq tools across various domains published from 2008 to 2020, discussing the interdisciplinary nature of bioinformatics involved in RNA sequencing, analysis, and software development.


title: Fusion 360 Gallery: A Dataset and Environment for Programmatic CAD Construction from Human Design Sequences

abstract: Parametric computer-aided design (CAD) is a standard paradigm used to design manufactured objects, where a 3D shape is represented as a program supported by the CAD software. Despite the pervasiveness of parametric CAD and a growing interest from the research community, currently there does not exist a dataset of realistic CAD models in a concise programmatic form. In this paper we present the Fusion 360 Gallery, consisting of a simple language with just the sketch and extrude modeling operations, and a dataset of 8,625 human design sequences expressed in this language. We also present an interactive environment called the Fusion 360 Gym, which exposes the sequential construction of a CAD program as a Markov decision process, making it amendable to machine learning approaches. As a use case for our dataset and environment, we define the CAD reconstruction task of recovering a CAD program from a target geometry. We report results of applying state-of-the-art methods of program synthesis with neurally guided search on this task.


title: Nuclear de-excitations in low-energy charged-current $\nu_e$ scattering on $^{40}$Ar

abstract: Background: Large argon-based neutrino detectors, such as those planned for the Deep Underground Neutrino Experiment, have the potential to provide unique sensitivity to low-energy (few to tens of MeV) electron neutrinos produced by core-collapse supernovae. Despite their importance for neutrino energy reconstruction, nuclear de-excitations following charged-current $\nu_e$ absorption on $^{40}$Ar have never been studied in detail at supernova energies. Purpose: I develop a model of nuclear de-excitations that occur following the $^{40}\mathrm{Ar}(\nu_e,e^{-})^{40}\mathrm{K}^*$ reaction. This model is applied to the calculation of exclusive cross sections. Methods: A simple expression for the inclusive differential cross section is derived under the allowed approximation. Nuclear de-excitations are described using a combination of measured $\gamma$-ray decay schemes and the Hauser-Feshbach statistical model. All calculations are carried out using a novel Monte Carlo event generator called MARLEY (Model of Argon Reaction Low Energy Yields). Results: Various total and differential cross sections are presented. Two de-excitation modes, one involving only $\gamma$-rays and the other including single neutron emission, are found to be dominant at few tens-of-MeV energies. Conclusions: Nuclear de-excitations have a strong impact on the achievable energy resolution for supernova $\nu_e$ detection in liquid argon. Tagging events involving neutron emission, though difficult, could substantially improve energy reconstruction. Given a suitable calculation of the inclusive cross section, the MARLEY nuclear de-excitation model may readily be applied to other scattering processes.


title: Mixup-Transformer: Dynamic Data Augmentation for NLP Tasks

abstract: Mixup is the latest data augmentation technique that linearly interpolates input examples and the corresponding labels. It has shown strong effectiveness in image classification by interpolating images at the pixel level. Inspired by this line of research, in this paper, we explore i) how to apply mixup to natural language processing tasks since text data can hardly be mixed in the raw format; ii) if mixup is still effective in transformer-based learning models, e.g., BERT. To achieve the goal, we incorporate mixup to transformer-based pre-trained architecture, named "mixup-transformer", for a wide range of NLP tasks while keeping the whole end-to-end training system. We evaluate the proposed framework by running extensive experiments on the GLUE benchmark. Furthermore, we also examine the performance of mixup-transformer in low-resource scenarios by reducing the training data with a certain ratio. Our studies show that mixup is a domain-independent data augmentation technique to pre-trained language models, resulting in significant performance improvement for transformer-based models.


title: A Generalized Constraint Approach to Bilingual Dictionary Induction for Low-Resource Language Families

abstract: The lack or absence of parallel and comparable corpora makes bilingual lexicon extraction a difficult task for low-resource languages. The pivot language and cognate recognition approaches have been proven useful for inducing bilingual lexicons for such languages. We propose constraint-based bilingual lexicon induction for closely-related languages by extending constraints from the recent pivot-based induction technique and further enabling multiple symmetry assumption cycles to reach many more cognates in the transgraph. We further identify cognate synonyms to obtain many-to-many translation pairs. This paper utilizes four datasets: one Austronesian low-resource language and three Indo-European high-resource languages. We use three constraint-based methods from our previous work, the Inverse Consultation method and translation pairs generated from the Cartesian product of input dictionaries as baselines. We evaluate our result using the metrics of precision, recall and F-score. Our customizable approach allows the user to conduct cross-validation to predict the optimal hyperparameters (cognate threshold and cognate synonym threshold) with various combinations of heuristics and the number of symmetry assumption cycles to gain the highest F-score. Our proposed methods have statistically significant improvement of precision and F-score compared to our previous constraint-based methods. The results show that our method demonstrates the potential to complement other bilingual dictionary creation methods like word alignment models using parallel corpora for high-resource languages while well handling low-resource languages.


title: Plan Optimization to Bilingual Dictionary Induction for Low-Resource Language Families

abstract: Creating bilingual dictionary is the first crucial step in enriching low-resource languages. Especially for the closely-related ones, it has been shown that the constraint-based approach is useful for inducing bilingual lexicons from two bilingual dictionaries via the pivot language. However, if there are no available machine-readable dictionaries as input, we need to consider manual creation by bilingual native speakers. To reach a goal of comprehensively create multiple bilingual dictionaries, even if we already have several existing machine-readable bilingual dictionaries, it is still difficult to determine the execution order of the constraint-based approach to reducing the total cost. Plan optimization is crucial in composing the order of bilingual dictionaries creation with the consideration of the methods and their costs. We formalize the plan optimization for creating bilingual dictionaries by utilizing Markov Decision Process (MDP) with the goal to get a more accurate estimation of the most feasible optimal plan with the least total cost before fully implementing the constraint-based bilingual lexicon induction. We model a prior beta distribution of bilingual lexicon induction precision with language similarity and polysemy of the topology as $\alpha$ and $\beta$ parameters. It is further used to model cost function and state transition probability. We estimated the cost of all investment plan as a baseline for evaluating the proposed MDP-based approach with total cost as an evaluation metric. After utilizing the posterior beta distribution in the first batch of experiments to construct the prior beta distribution in the second batch of experiments, the result shows 61.5\% of cost reduction compared to the estimated all investment plan and 39.4\% of cost reduction compared to the estimated MDP optimal plan. The MDP-based proposal outperformed the baseline on the total cost.


title: Microwave Hearing Effect: Cochlea as a Demodulator for Pulsed Microwaves

abstract: The phenomenon of Microwave Hearing Effect(MHE) can be explained by assuming the inner ear specifically the Human Cochlea to act as a receiving antenna for pulsed Microwaves. The spiral structure of the Cochlea picks up these incoming waves and demodulates it due to its directional conductivity and a net voltage is induced which explains the audible clicks as observed in MHE. Further, the maximum Electromagnetic absorption is observed near the side of the head where the cochlea is located.


title: A Recursive Logit Model with Choice Aversion and Its Application to Transportation Networks

abstract: We propose a recursive logit model which captures the notion of choice aversion by imposing a penalty term that accounts for the dimension of the choice set at each node of the transportation network. We make three contributions. First, we show that our model overcomes the correlation problem between routes, a common pitfall of traditional logit models, and that the choice aversion model can be seen as an alternative to these models. Second, we show how our model can generate violations of regularity in the path choice probabilities. In particular, we show that removing edges in the network may decrease the probability for existing paths. Finally, we show that under the presence of choice aversion, adding edges to the network can make users worse off. In other words, a type of Braess's paradox can emerge outside of congestion and can be characterized in terms of a parameter that measures users' degree of choice aversion. We validate these contributions by estimating this parameter over GPS traffic data captured on a real-world transportation network.


title: Guiding Attention for Self-Supervised Learning with Transformers

abstract: In this paper, we propose a simple and effective technique to allow for efficient self-supervised learning with bi-directional Transformers. Our approach is motivated by recent studies demonstrating that self-attention patterns in trained models contain a majority of non-linguistic regularities. We propose a computationally efficient auxiliary loss function to guide attention heads to conform to such patterns. Our method is agnostic to the actual pre-training objective and results in faster convergence of models as well as better performance on downstream tasks compared to the baselines, achieving state of the art results in low-resource settings. Surprisingly, we also find that linguistic properties of attention heads are not necessarily correlated with language modeling performance.


title: A Generalized Framework for Analytic Regularization of Uniform Cubic B-spline Displacement Fields

abstract: Image registration is an inherently ill-posed problem that lacks the constraints needed for a unique mapping between voxels of the two images being registered. As such, one must regularize the registration to achieve physically meaningful transforms. The regularization penalty is usually a function of derivatives of the displacement-vector field, and can be calculated either analytically or numerically. The numerical approach, however, is computationally expensive depending on the image size, and therefore a computationally efficient analytical framework has been developed. Using cubic B-splines as the registration transform, we develop a generalized mathematical framework that supports five distinct regularizers: diffusion, curvature, linear elastic, third-order, and total displacement. We validate our approach by comparing each with its numerical counterpart in terms of accuracy. We also provide benchmarking results showing that the analytic solutions run significantly faster -- up to two orders of magnitude -- than finite differencing based numerical implementations.


title: Tactical Patterns for Grassroots Urban Repair

abstract: The process of revitalizing cities in the United States suffers from balky and unresponsive processes---de jure egalitarian but de facto controlled and mediated by city officials and powerful interests, not residents. We argue that, instead, our goal should be to put city planning in the hands of the people, and to that end, give ordinary residents pattern-based planning tools to help them redesign (and repair) their urban surrounds. Through this, residents can explore many disparate ideas, try them, and, if successful, replicate them, enabling bottom-up city planning through direct action. We describe a prototype for such a tool that leverages classic patterns to enable city planning by residents, using case studies from Los Angeles as guides for both the problem and potential solution.


title: Searching for shocks in high-mass starless clump candidates

abstract: In order to search for shocks in the very early stage of star formation, we performed single-point surveys of SiO J=1-0, 2-1 and 3-2 lines and the H$_2$CO $2_{12}-1_{11}$ line toward a sample of 100 high-mass starless clump candidates (SCCs) by using the Korean VLBI Network (KVN) 21-m radio telescopes. The detection rates of the SiO J=1-0, 2-1, 3-2 lines and the H$_2$CO line are $31.0\%$, $31.0\%$, $19.5\%$ and $93.0\%$, respectively. Shocks seem to be common in this stage of massive star formation. The widths of the observed SiO lines (full width at zero power (FWZP)) range from 3.4 to 55.1 km s$^{-1}$. A significant fraction ($\sim29\%$) of the detected SiO spectra have broad line widths (FWZP $>20~km~s^{-1}$), which are very likely associated with fast shocks driven by protostellar outflows. This result suggests that about one third of the SiO-detected SCCs are not really starless but protostellar. On the other hand, about 40$\%$ of the detected SiO spectra show narrow line widths (FWZP<10 $km~s^{-1}$) probably associated with low-velocity shocks which are not necessarily protostellar in origin. The estimated SiO column densities are mostly $0.31-4.32\times10^{12}~cm^{-2}$. Comparing the SiO column densities derived from SiO J=1-0 and 2-1 lines, we suggest that the SiO molecules in the SCCs may be in the non-LTE condition. The SiO abundances to H$_2$ are usually $0.20-10.92\times10^{-10}$.