title: Identifying Human Strategies for Generating Word-Level Adversarial Examples

abstract: Adversarial examples in NLP are receiving increasing research attention. One line of investigation is the generation of word-level adversarial examples against fine-tuned Transformer models that preserve naturalness and grammaticality. Previous work found that human- and machine-generated adversarial examples are comparable in their naturalness and grammatical correctness. Most notably, humans were able to generate adversarial examples much more effortlessly than automated attacks. In this paper, we provide a detailed analysis of exactly how humans create these adversarial examples. By exploring the behavioural patterns of human workers during the generation process, we identify statistically significant tendencies based on which words humans prefer to select for adversarial replacement (e.g., word frequencies, word saliencies, sentiment) as well as where and when words are replaced in an input sequence. With our findings, we seek to inspire efforts that harness human strategies for more robust NLP models.


title: The VolcTrans System for WMT22 Multilingual Machine Translation Task

abstract: This report describes our VolcTrans system for the WMT22 shared task on large-scale multilingual machine translation. We participated in the unconstrained track which allows the use of external resources. Our system is a transformerbased multilingual model trained on data from multiple sources including the public training set from the data track, NLLB data provided by Meta AI, self-collected parallel corpora, and pseudo bitext from back-translation. A series of heuristic rules clean both bilingual and monolingual texts. On the official test set, our system achieves 17.3 BLEU, 21.9 spBLEU, and 41.9 chrF2++ on average over all language pairs. The average inference speed is 11.5 sentences per second using a single Nvidia Tesla V100 GPU. Our code and trained models are available at https://github.com/xian8/wmt22


title: Statistical Study and Live Catalogue of Multi-Spacecraft 3He-Rich Time Periods over Solar Cycles 23, 24, and 25

abstract: Using ion measurements from Ultra-Low-Energy Isotope Spectrometer (ULEIS) observations onboard Advanced Composition Explorer (ACE) and Solar Isotope Spectrometer (SIS) observations onboard the Solar Terrestrial Observatory (STEREO)-A and STEREO-B spacecraft, we have identified 854 3He-rich time periods between 1997 September and 2021 March. We include all event types with observed 3He enhancements such as corotating interaction regions (CIRs), gradual solar energetic particle (SEP) events, interplanetary shocks, and impulsive SEP events. We employ two different mass separation techniques to obtain 3He, 4He, Fe, and O fluences for each event, and we determine the 3He/4He and Fe/O abundance ratios between 0.32 to 0.45 MeV/nucleon and 0.64 to 1.28 MeV/nucleon. We find a clear correlation in the 3He/4He and Fe/O abundance ratios between both energy ranges. We find two distinct trends in the 3He/4He vs. Fe/O relation. For low 3He/4He values, there is a positive linear correlation between 3He/4He and Fe/O. However, at 3He/4He ~ 0.3, Fe/O appears to reach a limit and the correlation weakens significantly. We provide a live catalogue of 3He rich time periods that includes the robust determination of the onset and end times of the 3He enhancements in SEP-associated periods for different types of events observed my multiple spacecraft. This catalogue is available for public use. New releases will follow after major additions such as adding new periods from new missions (e.g., Parker Solar Probe and Solar Orbiter), identifying event types (impulsive SEP events, etc.), or adding new parameters such as remote observations detailing characteristics of the active regions.


title: gSuite: A Flexible and Framework Independent Benchmark Suite for Graph Neural Network Inference on GPUs

abstract: As the interest to Graph Neural Networks (GNNs) is growing, the importance of benchmarking and performance characterization studies of GNNs is increasing. So far, we have seen many studies that investigate and present the performance and computational efficiency of GNNs. However, the work done so far has been carried out using a few high-level GNN frameworks. Although these frameworks provide ease of use, they contain too many dependencies to other existing libraries. The layers of implementation details and the dependencies complicate the performance analysis of GNN models that are built on top of these frameworks, especially while using architectural simulators. Furthermore, different approaches on GNN computation are generally overlooked in prior characterization studies, and merely one of the common computational models is evaluated. Based on these shortcomings and needs that we observed, we developed a benchmark suite that is framework independent, supporting versatile computational models, easily configurable and can be used with architectural simulators without additional effort. Our benchmark suite, which we call gSuite, makes use of only hardware vendor's libraries and therefore it is independent of any other frameworks. gSuite enables performing detailed performance characterization studies on GNN Inference using both contemporary GPU profilers and architectural GPU simulators. To illustrate the benefits of our new benchmark suite, we perform a detailed characterization study with a set of well-known GNN models with various datasets; running gSuite both on a real GPU card and a timing-detailed GPU simulator. We also implicate the effect of computational models on performance. We use several evaluation metrics to rigorously measure the performance of GNN computation.


title: High-precision mass measurement of doubly magic $^{208}$Pb

abstract: The absolute atomic mass of $^{208}$Pb has been determined with a fractional uncertainty of $7\times 10^{-11}$ by measuring the cyclotron-frequency ratio $R$ of $^{208}$Pb$^{41+}$ to $^{132}$Xe$^{26+}$ with the high-precision Penning-trap mass spectrometer Pentatrap and computing the binding energies $E_{\text{Pb}}$ and $E_{\text{Xe}}$ of the missing 41 and 26 atomic electrons, respectively, with the ab initio fully relativistic multi-configuration Dirac-Hartree-Fock (MCDHF) method. $R$ has been measured with a relative precision of $9\times 10^{-12}$. $E_{\text{Pb}}$ and $E_{\text{Xe}}$ have been computed with an uncertainty of 9.1 eV and 2.1 eV, respectively, yielding $207.976\,650\,571(14)$ u (u$=9.314\,941\,024\,2(28)\times 10^{8}$ eV/c$^2$) for the $^{208}$Pb neutral atomic mass. This result agrees within $1.2\sigma$ with that from the Atomic-Mass Evaluation (AME) 2020, while improving the precision by almost two orders of magnitude. The new mass value directly improves the mass precision of 14 nuclides in the region of Z=81-84 and is the most precise mass value with A>200. Thus, the measurement establishes a new region of reference mass values which can be used e.g. for precision mass determination of transuranium nuclides, including the superheavies.


title: 3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows

abstract: Text-to-image AI are capable of generating novel images for inspiration, but their applications for 3D design workflows and how designers can build 3D models using AI-provided inspiration have not yet been explored. To investigate this, we integrated DALL-E, GPT-3, and CLIP within a CAD software in 3DALL-E, a plugin that generates 2D image inspiration for 3D design. 3DALL-E allows users to construct text and image prompts based on what they are modeling. In a study with 13 designers, we found that designers saw great potential in 3DALL-E within their workflows and could use text-to-image AI to produce reference images, prevent design fixation, and inspire design considerations. We elaborate on prompting patterns observed across 3D modeling tasks and provide measures of prompt complexity observed across participants. From our findings, we discuss how 3DALL-E can merge with existing generative design workflows and propose prompt bibliographies as a form of human-AI design history.


title: Horizon-Free and Variance-Dependent Reinforcement Learning for Latent Markov Decision Processes

abstract: We study regret minimization for reinforcement learning (RL) in Latent Markov Decision Processes (LMDPs) with context in hindsight. We design a novel model-based algorithmic framework which can be instantiated with both a model-optimistic and a value-optimistic solver. We prove an $\tilde{O}(\sqrt{\mathsf{Var}^\star M \Gamma S A K})$ regret bound where $\tilde{O}$ hides logarithm factors, $M$ is the number of contexts, $S$ is the number of states, $A$ is the number of actions, $K$ is the number of episodes, $\Gamma \le S$ is the maximum transition degree of any state-action pair, and $\mathsf{Var}^\star$ is a variance quantity describing the determinism of the LMDP. The regret bound only scales logarithmically with the planning horizon, thus yielding the first (nearly) horizon-free regret bound for LMDP. This is also the first problem-dependent regret bound for LMDP. Key in our proof is an analysis of the total variance of alpha vectors (a generalization of value functions), which is handled with a truncation method. We complement our positive result with a novel $\Omega(\sqrt{\mathsf{Var}^\star M S A K})$ regret lower bound with $\Gamma = 2$, which shows our upper bound minimax optimal when $\Gamma$ is a constant for the class of variance-bounded LMDPs. Our lower bound relies on new constructions of hard instances and an argument inspired by the symmetrization technique from theoretical computer science, both of which are technically different from existing lower bound proof for MDPs, and thus can be of independent interest.


title: Parametrizing spaces of positive representations

abstract: Using Lusztig's total positivity in split real Lie groups V. Fock and A. Goncharov have introduced spaces of positive (framed) representations. For general semisimple Lie groups a generalization of Lusztig's total positivity was recently introduced by O. Guichard and A. Wienhard. They also introduced the associated space of positive representations. Here we consider the corresponding spaces of positive framed representations of the fundamental group of a punctured surface. We give several parametrizations of the spaces of framed positive representations. Using these parametrizations, we describe their topology and their homotopy type. We show that the number of connected components of the space of framed positive representations agrees with the number of connected components of the space of positive representations, and determine this number for simple Lie groups. Along the way, we also parametrize, for an arbitrary semisimple Lie group, the space of representations of the fundamental group of a punctured surface which are transverse with respect to a fixed ideal triangulation of the surface.


title: Real time evolution and a traveling excitation in SU(2) pure gauge theory on a quantum computer

abstract: The Hamiltonian approach can be used successfully to study the real-time evolution of a non-Abelian lattice gauge theory on the available noisy quantum computers. In this work, results from the real-time evolution of SU(2) pure gauge theory on IBM hardware are presented. The long real-time evolution spanning dozens of Trotter steps with hundreds of CNOT gates and the observation of a traveling excitation on the lattice were made possible by using a collection of error mitigation techniques. Self-mitigation is our novel tool, which consists of using the same physics circuit as a noise-mitigation circuit.


title: On the robustness of inverse scattering for penetrable, homogeneous objects with complicated boundary

abstract: The acoustic inverse obstacle scattering problem consists of determining the shape of a domain from measurements of the scattered far field due to some set of incident fields (probes). For a penetrable object with known sound speed, this can be accomplished by treating the boundary alone as an unknown curve. Alternatively, one can treat the entire object as unknown and use a more general volumetric representation, without making use of the known sound speed. Both lead to strongly nonlinear and nonconvex optimization problems for which recursive linearization provides a useful framework for numerical analysis. After extending our shape optimization approach developed earlier for impenetrable bodies, we carry out a systematic study of both methods and compare their performance on a variety of examples. Our findings indicate that the volumetric approach is more robust, even though the number of degrees of freedom is significantly larger. We conclude with a discussion of this phenomenon and potential directions for further research.


title: Tag-Set-Sequence Learning for Generating Question-Answer Pairs

abstract: Transformer-based QG models can generate question-answer pairs (QAPs) with high qualities, but may also generate silly questions for certain texts. We present a new method called tag-set sequence learning to tackle this problem, where a tag-set sequence is a sequence of tag sets to capture the syntactic and semantic information of the underlying sentence, and a tag set consists of one or more language feature tags, including, for example, semantic-role-labeling, part-of-speech, named-entity-recognition, and sentiment-indication tags. We construct a system called TSS-Learner to learn tag-set sequences from given declarative sentences and the corresponding interrogative sentences, and derive answers to the latter. We train a TSS-Learner model for the English language using a small training dataset and show that it can indeed generate adequate QAPs for certain texts that transformer-based models do poorly. Human evaluation on the QAPs generated by TSS-Learner over SAT practice reading tests is encouraging.


title: Canonical Nonlinearity for Coupled Linear Systems

abstract: For classical discrete system under constant composition, typically reffered to as substitutional alloys, correspondence between interatomic many-body interactions and structure in thermodynamic equilibrium exhibit profound, complicated nonlinearity (canonical nonlinearity). Our recent studies clarify that the nonlinearity can be reasonablly described both by specially-introduced vector field on configuration space and by corresponding diverngence on statistical manifold. While these studies shown that the correlation between vector field and local contribution to the divergence can be well characterized by coordination number for a set of selected structural degree of freedoms (SDFs), it is unclear whether the correlations between different set of SDFs purely comes from the difference in covariance matrix of CDOS (determined by coordination number) or additional information such as the shape of CP should be further required. To clarify the problem, we here propose simplified model of the so-called Coupled Linear System (CLS), which consists of the m-mixture of the configurational density of states for linear systems. We demonstrate that the CLS can reasonablly capture the changes in the local nonlinearity w.r.t. the changes in coordination number. Through the dynamic mode decomposition on CLS, we elucidate that there exists two dominant modes to capture the changes in the nonlinearity, where the one uniformly evolves from random to ordered configuration, and the another individually evolves around random, partially ordered and ordered configuration.


title: Large Language Models Can Self-Improve

abstract: Large Language Models (LLMs) have achieved excellent performances in various tasks. However, fine-tuning an LLM requires extensive supervision. Human, on the other hand, may improve their reasoning abilities by self-thinking without external inputs. In this work, we demonstrate that an LLM is also capable of self-improving with only unlabeled datasets. We use a pre-trained LLM to generate "high-confidence" rationale-augmented answers for unlabeled questions using Chain-of-Thought prompting and self-consistency, and fine-tune the LLM using those self-generated solutions as target outputs. We show that our approach improves the general reasoning ability of a 540B-parameter LLM (74.4%->82.1% on GSM8K, 78.2%->83.0% on DROP, 90.0%->94.4% on OpenBookQA, and 63.4%->67.9% on ANLI-A3) and achieves state-of-the-art-level performance, without any ground truth label. We conduct ablation studies and show that fine-tuning on reasoning is critical for self-improvement.


title: 3D Bivariate Spatial Modelling of Argo Ocean Temperature and Salinity Profiles

abstract: Variables contained within the global oceans can detect and reveal the effects of the warming climate as the oceans absorb huge amounts of solar energy. Hence, information regarding the joint spatial distribution of ocean variables is critical for climate monitoring. In this paper, we investigate the spatial correlation structure between ocean temperature and salinity using data harvested from the Argo program and construct a model to capture their bivariate spatial dependence from the surface to the ocean's interior. We develop a flexible class of multivariate nonstationary covariance models defined in 3-dimensional (3D) space (longitude x latitude x depth) that allows for the variances and correlation to change along the vertical pressure dimension. These models are able to describe the joint spatial distribution of the two variables while incorporating the underlying vertical structure of the ocean. We demonstrate that proposed cross-covariance models describe the complex vertical cross-covariance structure well, while existing cross-covariance models including bivariate Mat\'{e}rn models poorly fit empirical cross-covariance structure. Furthermore, the results show that using one more variable significantly enhances the prediction of the other variable and that the estimated spatial dependence structures are consistent with the ocean stratification.


title: Searching for a higher power in the human evaluation of MT

abstract: In MT evaluation, pairwise comparisons are conducted to identify the better system. In conducting the comparison, the experimenter must allocate a budget to collect Direct Assessment (DA) judgments. We provide a cost effective way to spend the budget, but show that typical budget sizes often do not allow for solid comparison. Taking the perspective that the basis of solid comparison is in achieving statistical significance, we study the power (rate of achieving significance) on a large collection of pairwise DA comparisons. Due to the nature of statistical estimation, power is low for differentiating less than 1-2 DA points, and to achieve a notable increase in power requires at least 2-3x more samples. Applying variance reduction alone will not yield these gains, so we must face the reality of undetectable differences and spending increases. In this context, we propose interim testing, an "early stopping" collection procedure that yields more power per judgment collected, which adaptively focuses the budget on pairs that are borderline significant. Interim testing can achieve up to a 27% efficiency gain when spending 3x the current budget, or 18% savings at the current evaluation power.


title: Quantum logic control and precision measurements of molecular ions in a ring trap -- a new approach for testing fundamental symmetries

abstract: We present a new platform facilitating quantum logic control of polar molecular ions in a segmented ring ion trap, paving the way for precision measurements. This approach focuses on achieving near-unity state preparation and detection, as well as long spin coherence. A distinctive aspect lies in separating state preparation and detection conducted in a static frame, from parity-selective spin-precession in a rotating frame. This method can be applied to a wide range of ion species and will be used to search for the electron's electric dipole moment and the nuclear magnetic quadrupole moment.


title: Stochastic methods for slip prediction in a sheared granular system

abstract: We consider a sheared granular system experiencing intermittent dynamics of stick-slip type via discrete element simulations. The considered setup consists of a two-dimensional system of soft frictional particles sandwiched between solid walls, one of which is exposed to a shearing force. The slip events are detected using stochastic state space models applied to various measures describing the system. We show that the measures describing the forces between the particles provide earlier detection of an upcoming slip event than the measures based solely on the wall movement. By comparing the detection times obtained from the considered measures, we observe that a typical slip event starts with a local change in the force network. However, some local changes do not spread globally over the force network. For the changes that become global, we find a sharp critical value for their size. If the size of a global change exceeds the critical value, then it triggers a slip event; if it does not, then a much weaker micro-slip follows. Quantification of the changes in the force network is made possible by formulating clear and precise measures describing their static and dynamic properties.


title: A new quasi-one-dimensional transition metal chalcogenide semiconductor (Nb$_4$Se$_{15}$I$_2$)I$_2$

abstract: The discovery of new low-dimensional transition metal chalcogenides is contributing to the already prosperous family of these materials. In this study, needle-shaped single crystals of a new quasi-one-dimensional material (Nb$_4$Se$_{15}$I$_2$)I$_2$ were grown by chemical vapor transport, and the structure was solved by single crystal X-ray diffraction (XRD). The new structure has one-dimensional (Nb$_4$Se$_{15}$I$_2$)$_n$ chains along the [101] direction, with two I$^-$ ions per formula unit directly bonded to Nb$^{5+}$. The other two I$^-$ ions are loosely coordinated and intercalate between the chains. Individual chains are chiral, and stack along the $b$ axis in opposing directions, giving space group $P2_1/c$. The phase purity and crystal structure was verified by powder XRD. Density functional theory calculations show (Nb$_4$Se$_{15}$I$_2$)I$_2$ to be a semiconductor with a direct band gap of around 0.6 eV. Resistivity measurements of bulk crystals and micro-patterned devices demonstrate that (Nb$_4$Se$_{15}$I$_2$)I$_2$ has an activation energy of around 0.1 eV, and no anomaly or transition was seen upon cooling. (Nb$_4$Se$_{15}$I$_2$)I$_2$ does not undergo structural phase transformation from room temperature down to 8.2 K, based on cryogenic temperature single crystal XRD. This compound represents a well-characterized and valence-precise member of a diverse family of anisotropic transition metal chalcogenides.


title: Generalized Reciprocal Perspective

abstract: Across many domains, real-world problems can be represented as a network. Nodes represent domain-specific elements and edges capture the relationship between elements. Leveraging high-performance computing and optimized link prediction algorithms, it is increasingly possible to evaluate every possible combination of nodal pairs enabling the generation of a comprehensive prediction matrix (CPM) that places an individual link prediction score in the context of all possible links involving either node (providing data-driven context). Historically, this contextual information has been ignored given exponentially growing problem sizes resulting in computational intractability; however, we demonstrate that expending high-performance compute resources to generate CPMs is a worthwhile investment given the improvement in predictive performance. In this work, we generalize for all pairwise link-prediction tasks our novel semi-supervised machine learning method, denoted Reciprocal Perspective (RP). We demonstrate that RP significantly improves link prediction accuracy by leveraging the wealth of information in a CPM. Context-based features are extracted from the CPM for use in a stacked classifier and we demonstrate that the application of RP in a cascade almost always results in significantly (p < 0.05) improved predictions. These results on RS-type problems suggest that RP is applicable to a broad range of link prediction problems.


title: Boosting Natural Language Generation from Instructions with Meta-Learning

abstract: Recent work has shown that language models (LMs) trained with multi-task \textit{instructional learning} (MTIL) can solve diverse NLP tasks in zero- and few-shot settings with improved performance compared to prompt tuning. MTIL illustrates that LMs can extract and use information about the task from instructions beyond the surface patterns of the inputs and outputs. This suggests that meta-learning may further enhance the utilization of instructions for effective task transfer. In this paper we investigate whether meta-learning applied to MTIL can further improve generalization to unseen tasks in a zero-shot setting. Specifically, we propose to adapt meta-learning to MTIL in three directions: 1) Model Agnostic Meta Learning (MAML), 2) Hyper-Network (HNet) based adaptation to generate task specific parameters conditioned on instructions, and 3) an approach combining HNet and MAML. Through extensive experiments on the large scale Natural Instructions V2 dataset, we show that our proposed approaches significantly improve over strong baselines in zero-shot settings. In particular, meta-learning improves the effectiveness of instructions and is most impactful when the test tasks are strictly zero-shot (i.e. no similar tasks in the training set) and are "hard" for LMs, illustrating the potential of meta-learning for MTIL for out-of-distribution tasks.


title: Multitasking Models are Robust to Structural Failure: A Neural Model for Bilingual Cognitive Reserve

abstract: We find a surprising connection between multitask learning and robustness to neuron failures. Our experiments show that bilingual language models retain higher performance under various neuron perturbations, such as random deletions, magnitude pruning and weight noise compared to equivalent monolingual ones. We provide a theoretical justification for this robustness by mathematically analyzing linear representation learning and showing that multitasking creates more robust representations. Our analysis connects robustness to spectral properties of the learned representation and proves that multitasking leads to higher robustness for diverse task vectors. We open-source our code and models: https://github.com/giannisdaras/multilingual_robustness


title: Few-cycle pulse generation by double-stage hybrid multi-pass multi-plate nonlinear pulse compression

abstract: Few-cycle pulses present an essential tool to track ultrafast dynamics in matter and drive strong field effects. To address photon-hungry applications, high average power lasers are used which, however, cannot directly provide sub-100 fs pulse durations. Post-compression of laser pulses by spectral broadening and dispersion compensation is the most efficient method to overcome this limitation. Here, we demonstrate a notably compact setup which turns a 0.1 GW peak power, picosecond laser into a 2.9 GW peak power, 8.2 fs source. The 120-fold pulse duration shortening is accomplished in a two-stage hybrid multi-pass, multi-plate compression setup. To our knowledge, neither shorter pulses, nor higher peak powers have been reported to-date from bulk multi-pass cells alone, manifesting the power of the hybrid approach. It puts, for instance, compact, cost-efficient and high repetition rate attosecond sources within reach.


title: LOT: Layer-wise Orthogonal Training on Improving $\ell_2$ Certified Robustness

abstract: Recent studies show that training deep neural networks (DNNs) with Lipschitz constraints are able to enhance adversarial robustness and other model properties such as stability. In this paper, we propose a layer-wise orthogonal training method (LOT) to effectively train 1-Lipschitz convolution layers via parametrizing an orthogonal matrix with an unconstrained matrix. We then efficiently compute the inverse square root of a convolution kernel by transforming the input domain to the Fourier frequency domain. On the other hand, as existing works show that semi-supervised training helps improve empirical robustness, we aim to bridge the gap and prove that semi-supervised learning also improves the certified robustness of Lipschitz-bounded models. We conduct comprehensive evaluations for LOT under different settings. We show that LOT significantly outperforms baselines regarding deterministic l2 certified robustness, and scales to deeper neural networks. Under the supervised scenario, we improve the state-of-the-art certified robustness for all architectures (e.g. from 59.04% to 63.50% on CIFAR-10 and from 32.57% to 34.59% on CIFAR-100 at radius rho = 36/255 for 40-layer networks). With semi-supervised learning over unlabelled data, we are able to improve state-of-the-art certified robustness on CIFAR-10 at rho = 108/255 from 36.04% to 42.39%. In addition, LOT consistently outperforms baselines on different model architectures with only 1/3 evaluation time.


title: SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages

abstract: In recent years, multilingual machine translation models have achieved promising performance on low-resource language pairs by sharing information between similar languages, thus enabling zero-shot translation. To overcome the "curse of multilinguality", these models often opt for scaling up the number of parameters, which makes their use in resource-constrained environments challenging. We introduce SMaLL-100, a distilled version of the M2M-100 (12B) model, a massively multilingual machine translation model covering 100 languages. We train SMaLL-100 with uniform sampling across all language pairs and therefore focus on preserving the performance of low-resource languages. We evaluate SMaLL-100 on different low-resource benchmarks: FLORES-101, Tatoeba, and TICO-19 and demonstrate that it outperforms previous massively multilingual models of comparable sizes (200-600M) while improving inference latency and memory usage. Additionally, our model achieves comparable results to M2M-100 (1.2B), while being 3.6x smaller and 4.3x faster at inference. Code and pre-trained models: https://github.com/alirezamshi/small100


title: X-Ray Luminous Supernovae: Threats to Terrestrial Biospheres

abstract: The spectacular outbursts of energy associated with supernovae (SNe) have long motivated research into their potentially hazardous effects on Earth and analogous environments. Much of this research has focused primarily on the atmospheric damage associated with the prompt arrival of ionizing photons within days or months of the initial outburst, and the high-energy cosmic rays that arrive thousands of years after the explosion. In this study, we turn the focus to persistent X-ray emission, arising in certain SNe that have interactions with a dense circumstellar medium, and observed months and/or years after the initial outburst. The sustained high X-ray luminosity leads to large doses of ionizing radiation out to formidable distances. We provide an assessment of the threat posed by these X-ray luminous SNe by analyzing the collective X-ray observations from Chandra, Swift-XRT, XMM-Newton, NuSTAR, and others. We find that this threat is particularly acute for SNe showing evidence of strong circumstellar interaction, such as Type IIn explosions, which have significantly larger ranges of influence than previously expected, and lethal consequences up to $\sim$ 50 pc away. Furthermore, X-ray bright SNe could pose a substantial and distinct threat to terrestrial biospheres, and tighten the Galactic habitable zone. We urge follow-up X-ray observations of interacting SNe for months and years after the explosion to shed light on the physical nature of the emission and its full time evolution, and to clarify the danger that these events pose for life in our Galaxy and other star-forming regions.


title: Perturbation of eigenvalues of the Klein Gordon operators II

abstract: We give estimates for the changes of the eigenvalues of the Klein Gordon operator under the change of the potential. In some relevant situations we improve the existing estimates. We test our results on some exactly solvable models (Coulomb potential, Klein-Gordon oscillator).


title: Sparse Dynamical Features generation, application to Parkinson's Disease diagnosis

abstract: In this study we focus on the diagnosis of Parkinson's Disease (PD) based on electroencephalogram (EEG) signals. We propose a new approach inspired by the functioning of the brain that uses the dynamics, frequency and temporal content of EEGs to extract new demarcating features of the disease. The method was evaluated on a publicly available dataset containing EEG signals recorded during a 3-oddball auditory task involving N = 50 subjects, of whom 25 suffer from PD. By extracting two features, and separating them with a straight line using a Linear Discriminant Analysis (LDA) classifier, we can separate the healthy from the unhealthy subjects with an accuracy of 90 % $(p < 0.03)$ using a single channel. By aggregating the information from three channels and making them vote, we obtain an accuracy of 94 %, a sensitivity of 96 % and a specificity of 92 %. The evaluation was carried out using a nested Leave-One-Out cross-validation procedure, thus preventing data leakage problems and giving a less biased evaluation. Several tests were carried out to assess the validity and robustness of our approach, including the test where we use only half the available data for training. Under this constraint, the model achieves an accuracy of 83.8 %.


title: Graphical Model Inference with Erosely Measured Data

abstract: In this paper, we investigate the Gaussian graphical model inference problem in a novel setting that we call erose measurements, referring to irregularly measured or observed data. For graphs, this results in different node pairs having vastly different sample sizes which frequently arises in data integration, genomics, neuroscience, and sensor networks. Existing works characterize the graph selection performance using the minimum pairwise sample size, which provides little insights for erosely measured data, and no existing inference method is applicable. We aim to fill in this gap by proposing the first inference method that characterizes the different uncertainty levels over the graph caused by the erose measurements, named GI-JOE (Graph Inference when Joint Observations are Erose). Specifically, we develop an edge-wise inference method and an affiliated FDR control procedure, where the variance of each edge depends on the sample sizes associated with corresponding neighbors. We prove statistical validity under erose measurements, thanks to careful localized edge-wise analysis and disentangling the dependencies across the graph. Finally, through simulation studies and a real neuroscience data example, we demonstrate the advantages of our inference methods for graph selection from erosely measured data.


title: Optimal plug-in Gaussian processes for modelling derivatives

abstract: Derivatives are a key nonparametric functional in wide-ranging applications where the rate of change of an unknown function is of interest. In the Bayesian paradigm, Gaussian processes (GPs) are routinely used as a flexible prior for unknown functions, and are arguably one of the most popular tools in many areas. However, little is known about the optimal modelling strategy and theoretical properties when using GPs for derivatives. In this article, we study a plug-in strategy by differentiating the posterior distribution with GP priors for derivatives of any order. This practically appealing plug-in GP method has been previously perceived as suboptimal and degraded, but this is not necessarily the case. We provide posterior contraction rates for plug-in GPs and establish that they remarkably adapt to derivative orders. We show that the posterior measure of the regression function and its derivatives, with the same choice of hyperparameter that does not depend on the order of derivatives, converges at the minimax optimal rate up to a logarithmic factor for functions in certain classes. We analyze a data-driven hyperparameter tuning method based on empirical Bayes, and show that it satisfies the optimal rate condition while maintaining computational efficiency. This article to the best of our knowledge provides the first positive result for plug-in GPs in the context of inferring derivative functionals, and leads to a practically simple nonparametric Bayesian method with optimal and adaptive hyperparameter tuning for simultaneously estimating the regression function and its derivatives. Simulations show competitive finite sample performance of the plug-in GP method. A climate change application for analyzing the global sea-level rise is discussed.


title: Obvious manipulations of tops-only voting rules

abstract: In a voting problem with a finite set of alternatives to choose from, we study the manipulation of tops-only rules. Since all non-dictatorial (onto) voting rules are manipulable when there are more than two alternatives and all preferences are allowed, we look for rules in which manipulations are not obvious. First, we show that a rule does not have obvious manipulations if and only if when an agent vetoes an alternative it can do so with any preference that does not have such alternative in the top. Second, we focus on two classes of tops-only rules: (i) (generalized) median voter schemes, and (ii) voting by committees. For each class, we identify which rules do not have obvious manipulations on the universal domain of preferences.


title: Can Domains Be Transferred Across Languages in Multi-Domain Multilingual Neural Machine Translation?

abstract: Previous works mostly focus on either multilingual or multi-domain aspects of neural machine translation (NMT). This paper investigates whether the domain information can be transferred across languages on the composition of multi-domain and multilingual NMT, particularly for the incomplete data condition where in-domain bitext is missing for some language pairs. Our results in the curated leave-one-domain-out experiments show that multi-domain multilingual (MDML) NMT can boost zero-shot translation performance up to +10 gains on BLEU, as well as aid the generalisation of multi-domain NMT to the missing domain. We also explore strategies for effective integration of multilingual and multi-domain NMT, including language and domain tag combination and auxiliary task training. We find that learning domain-aware representations and adding target-language tags to the encoder leads to effective MDML-NMT.


title: Massive Prestellar Cores in Radiation-magneto-turbulent Simulations of Molecular Clouds

abstract: We simulate the formation and collapse of prestellar cores at few-AU resolution in a set of radiation-magneto-hydrodynamic simulations of giant molecular clouds (GMCs) using the grid-based code RAMSES-RT. We adopt, for the first time to our best knowledge, realistic initial/boundary conditions by zooming-in onto individual massive prestellar cores within the GMC. We identify two distinct modes of fragmentation: "quasi-spherical" and "filamentary". In both modes the fragments eventually become embedded in a quasi-steady accretion disk or toroid with radii ~ 500-5000 AU and opening angles $H/R \sim 0.5-1$. The disks/toroids are Toomre stable but the accreted pre-existing fragments are found orbiting the outer disk, appearing as disk fragmentation. Each core converts nearly 100 percent of the gas mass into a few massive stars forming near the disk center. Large and massive disks around high-mass stars are supported by magnetic pressure in the outer disk, at radii >200-1000 AU, and turbulent pressure in the inner disk. The most massive core accretes several times more mass than its initial mass, forming a (proto)star cluster of 8 massive stars enshrouded by a toroid, suggesting a competitive accretion scenario for ultra-high-mass star formation. We also find that the HII regions produced by a single massive star remain trapped in the dense circumstellar disks for a few hundred kiloyears, while the dynamic motions of massive stars in wide binaries or multiple systems displace the stars from the densest parts of the disk, allowing UV radiation to escape producing steady or pulsating bipolar HII regions.


title: Using Large Language Models to Enhance Programming Error Messages

abstract: A key part of learning to program is learning to understand programming error messages. They can be hard to interpret and identifying the cause of errors can be time-consuming. One factor in this challenge is that the messages are typically intended for an audience that already knows how to program, or even for programming environments that then use the information to highlight areas in code. Researchers have been working on making these errors more novice friendly since the 1960s, however progress has been slow. The present work contributes to this stream of research by using large language models to enhance programming error messages with explanations of the errors and suggestions on how to fix the error. Large language models can be used to create useful and novice-friendly enhancements to programming error messages that sometimes surpass the original programming error messages in interpretability and actionability. These results provide further evidence of the benefits of large language models for computing educators, highlighting their use in areas known to be challenging for students. We further discuss the benefits and downsides of large language models and highlight future streams of research for enhancing programming error messages.


title: Anomalous scaling law for thermoelectric transport of 2D-confined electrons in an organic molecular system

abstract: Confined electrons in low dimensions host desirable material functions for downscaled electronics as well as advanced energy technologies. Thermoelectricity is a most fascinating example, since the dimensionality modifies the electron density of states dramatically, leading to enhanced thermopower as experimentally examined in artificial two-dimensional (2D) structures. However, it is still an open question whether such an enhanced thermopower in low dimensions is realized in layered materials with strong 2D characters such as cuprates. Here, we report unusual enhancement of the thermopower in the layered organic compound $\alpha$-(BEDT-TTF)$_2$I$_3$, where BEDT-TTF stands for bis(ethylenedithio)-tetrathiafulvalene. We find that the slope in the Jonker plot (thermopower $S$ vs. logarithm of electrical conductivity $\log\sigma$) for $\alpha$-(BEDT-TTF)$_2$I$_3$ is significantly larger than that of conventional semiconductors. Moreover, the large slope is also seen in the related layered salt, demonstrating the impact of the 2D-confined carriers in the layered organics on thermoelectricity.


title: Quantitative limit theorems via relative log-concavity

abstract: In this paper we develop tools for studying limit theorems by means of convexity. We establish bounds for the discrepancy in total variation between probability measures $\mu$ and $\nu$ such that $\nu$ is log-concave with respect to $\mu$. We discuss a variety of applications, which include geometric and binomial approximations to sums of random variables, and discrepancy between Gamma distributions. As special cases we obtain a law of rare events for intrinsic volumes, quantitative bounds on proximity to geometric for infinitely divisible distributions, as well as binomial and Poisson approximation for matroids.


title: Graphically Structured Diffusion Models

abstract: We introduce a framework for automatically defining and learning deep generative models with problem-specific structure. We tackle problem domains that are more traditionally solved by algorithms such as sorting, constraint satisfaction for Sudoku, and matrix factorization. Concretely, we train diffusion models with an architecture tailored to the problem specification. This problem specification should contain a graphical model describing relationships between variables, and often benefits from explicit representation of subcomputations. Permutation invariances can also be exploited. Across a diverse set of experiments we improve the scaling relationship between problem dimension and our model's performance, in terms of both training time and final accuracy. Our code can be found at https://github.com/plai-group/gsdm.


title: A Polynomial-time Algorithm for the Large Scale of Airplane Refueling Problem

abstract: Airplane refueling problem is a nonlinear unconstrained optimization problem with $n!$ feasible solutions. Given a fleet of $n$ airplanes with mid-air refueling technique, the question is to find the best refueling policy to make the last remaining airplane travels the farthest. In order to deal with the large scale of airplanes refueling instances, we proposed the definition of sequential feasible solution by employing the refueling properties of data structure. We proved that if an airplanes refueling instance has feasible solutions, it must have the sequential feasible solutions; and the optimal feasible solution must be the optimal sequential feasible solution. Then we proposed the sequential search algorithm which consists of two steps. The first step of the sequential search algorithm aims to seek out all of the sequential feasible solutions. When the input size of $n$ is greater than an index number, we proved that the number of the sequential feasible solutions will change to grow at a polynomial rate. The second step of the sequential search algorithm aims to search for the maximal sequential feasible solution by bubble sorting all of the sequential feasible solutions. Moreover, we built an efficient computability scheme, according to which we could forecast within a polynomial time the computational complexity of the sequential search algorithm that runs on any given airplanes refueling instance. Thus we could provide a computational strategy for decision makers or algorithm users by considering with their available computing resources.


title: Untilts of fundamental groups: construction of labeled isomorphs of fundamental groups -- Arithmetic Holomorphic Structures

abstract: Let $p$ be a prime number. Let $X/E$ be a geometrically connected, smooth, quasi-projective variety over a finite extension $E/\mathbb{Q}_p$. In this paper I demonstrate the existence of isomorphs of the tempered (and hence also \'etale) fundamental group of $X/E$ which are labeled by distinct arithmetic holomorphic structures, just as isomorphs of the fundamental group of a Riemann surface $\Sigma$ may be labeled by Riemann surfaces (i.e. complex holomorphic structures) $\Sigma'$ in the Teichmuller space of $\Sigma$. This is the starting point of the theory elaborated in [Joshi, 2021a,b,c, 2022] for which this paper is intended as an brief sketch and announcement. Arithmetic holomorphic structures introduced here also provide distinct arithmetic holomorphic structures used by Shinichi Mochizuki in [Mochizuki,2021a,b,c,d]. Since the question of whether or not there exists distinct arith. hol. structures in [Mochizuki,2021a,b,c,d] was raised in [Scholze and Stix], I include a discussion of [Scholze and Stix]. See the introduction for additional details.


title: Self-Censorship Under Law: A Case Study of the Hong Kong National Security Law

abstract: We study how legislation that restricts speech can induce online self-censorship and alter online discourse, using the recent Hong Kong national security law as a case study. We collect a dataset of 7 million historical Tweets from Hong Kong users, supplemented with historical snapshots of Tweet streams collected by other researchers. We compare online activity before and after enactment of the national security law, and we find that Hong Kong users demonstrate two types of self-censorship. First, Hong Kong users are more likely than a control group, sampled randomly from historical snapshots of Tweet streams, to remove past online activity. Specifically, Hong Kong users are over a third more likely than the control group to delete or restrict their account and over twice as likely to delete past posts. Second, we find that Hong Kong users post less often about politically sensitive topics that have been censored on social media in mainland China. This trend continues to increase.


title: Slippage-robust Gaze Tracking for Near-eye Display

abstract: In recent years, head-mounted near-eye display devices have become the key hardware foundation for virtual reality and augmented reality. Thus head-mounted gaze tracking technology has received attention as an essential part of human-computer interaction. However, unavoidable slippage of head-mounted devices (HMD) often results higher gaze tracking errors and hinders the practical usage of HMD. To tackle this problem, we propose a slippage-robust gaze tracking for near-eye display method based on the aspheric eyeball model and accurately compute the eyeball optical axis and rotation center. We tested several methods on datasets with slippage and the experimental results show that the proposed method significantly outperforms the previous method (almost double the suboptimal method).


title: A single-species population in a refuge subject to heterogeneous diffusion

abstract: We consider a modified nonlocal FKPP equation to describe the spatial organization of a single-species population in a refuge (high-quality region immersed in a hostile environment). In addition to the spatial-dependence of the growth rate, which is the main distinguishing feature of a refuge, it is realistic to consider that also the mobility can be heterogeneous. We focus on two cases where the diffusivity responds to the population density, either decreasing or increasing with population density. This state dependency can produce a feedback that is missing in homogeneous environments. For comparison, we also address space-dependent diffusivity with different values inside and outside the refuge. The objective is to characterize how the diffusion variability affects the spatial organization of the population inside and outside the refuge. We note that the conditions for pattern formation within the refuge are not strongly affected by the heterogeneity in the diffusivity profile, but this affects the shape and stability of the patterns.


title: HesScale: Scalable Computation of Hessian Diagonals

abstract: Second-order optimization uses curvature information about the objective function, which can help in faster convergence. However, such methods typically require expensive computation of the Hessian matrix, preventing their usage in a scalable way. The absence of efficient ways of computation drove the most widely used methods to focus on first-order approximations that do not capture the curvature information. In this paper, we develop HesScale, a scalable approach to approximating the diagonal of the Hessian matrix, to incorporate second-order information in a computationally efficient manner. We show that HesScale has the same computational complexity as backpropagation. Our results on supervised classification show that HesScale achieves high approximation accuracy, allowing for scalable and efficient second-order optimization.


title: Not All Asians are the Same: A Disaggregated Approach to Identifying Anti-Asian Racism in Social Media

abstract: Recent policy initiatives have acknowledged the importance of disaggregating data pertaining to diverse Asian ethnic communities to gain a more comprehensive understanding of their current status and to improve their overall well-being. However, research on anti-Asian racism has thus far fallen short of properly incorporating data disaggregation practices. Our study addresses this gap by collecting 12-month-long data from X (formerly known as Twitter) that contain diverse sub-ethnic group representations within Asian communities. In this dataset, we break down anti-Asian toxic messages based on both temporal and ethnic factors and conduct a series of comparative analyses of toxic messages, targeting different ethnic groups. Using temporal persistence analysis, $n$-gram-based correspondence analysis, and topic modeling, this study provides compelling evidence that anti-Asian messages comprise various distinctive narratives. Certain messages targeting sub-ethnic Asian groups entail different topics that distinguish them from those targeting Asians in a generic manner or those aimed at major ethnic groups, such as Chinese and Indian. By introducing several techniques that facilitate comparisons of online anti-Asian hate towards diverse ethnic communities, this study highlights the importance of taking a nuanced and disaggregated approach for understanding racial hatred to formulate effective mitigation strategies.


title: Model exploration in gravitational-wave astronomy with the maximum population likelihood

abstract: Hierarchical Bayesian inference is an essential tool for studying the population properties of compact binaries with gravitational waves. The basic premise is to infer the unknown prior distribution of binary black hole and/or neutron star parameters such component masses, spin vectors, and redshift. These distributions shed light on the fate of massive stars, how and where binaries are assembled, and the evolution of the Universe over cosmic time. Hierarchical analyses model the binary black hole population using a prior distribution conditioned on hyper-parameters, which are inferred from the data. However, a misspecified model can lead to faulty astrophysical inferences. In this paper we answer the question: given some data, which prior distribution--from the set of all possible prior distributions--produces the largest possible population likelihood? This distribution (which is not a true prior) is $\pistroke$ (pronounced "pi stroke"), and the associated \textit{maximum population likelihood} is $\Lstroke$ (pronounced "L stroke"). The structure of $\pistroke$ is a linear superposition of delta functions, a result which follows from Carath{\'e}odory's theorem. We show how $\pistroke$ and $\Lstroke$ can be used for model exploration/criticism. We apply this $\Lstroke$ formalism to study the population of binary black hole mergers observed in LIGO--Virgo--KAGRA's third Gravitational-Wave Transient Catalog. Based on our results, we discuss possible improvements for gravitational-wave population models.


title: Improving Semi-supervised End-to-end Automatic Speech Recognition using CycleGAN and Inter-domain Losses

abstract: We propose a novel method that combines CycleGAN and inter-domain losses for semi-supervised end-to-end automatic speech recognition. Inter-domain loss targets the extraction of an intermediate shared representation of speech and text inputs using a shared network. CycleGAN uses cycle-consistent loss and the identity mapping loss to preserve relevant characteristics of the input feature after converting from one domain to another. As such, both approaches are suitable to train end-to-end models on unpaired speech-text inputs. In this paper, we exploit the advantages from both inter-domain loss and CycleGAN to achieve better shared representation of unpaired speech and text inputs and thus improve the speech-to-text mapping. Our experimental results on the WSJ eval92 and Voxforge (non English) show 8~8.5% character error rate reduction over the baseline, and the results on LibriSpeech test_clean also show noticeable improvement.


title: All Politics is Local: Redistricting via Local Fairness

abstract: In this paper, we propose to use the concept of local fairness for auditing and ranking redistricting plans. Given a redistricting plan, a deviating group is a population-balanced contiguous region in which a majority of individuals are of the same interest and in the minority of their respective districts; such a set of individuals have a justified complaint with how the redistricting plan was drawn. A redistricting plan with no deviating groups is called locally fair. We show that the problem of auditing a given plan for local fairness is NP-complete. We present an MCMC approach for auditing as well as ranking redistricting plans. We also present a dynamic programming based algorithm for the auditing problem that we use to demonstrate the efficacy of our MCMC approach. Using these tools, we test local fairness on real-world election data, showing that it is indeed possible to find plans that are almost or exactly locally fair. Further, we show that such plans can be generated while sacrificing very little in terms of compactness and existing fairness measures such as competitiveness of the districts or seat shares of the plans.


title: High-speed detection of 1550 nm single photons with superconducting nanowire detectors

abstract: Superconducting nanowire single photon detectors are a key technology for quantum information and science due to their high efficiency, low timing jitter, and low dark counts. In this work, we present a detector for single 1550 nm photons with up to 78% detection efficiency, timing jitter below 50 ps FWHM, 158 counts/s dark count rate - as well as a world-leading maximum count rate of 1.5 giga-counts/s at 3 dB compression. The PEACOQ detector (Performance-Enhanced Array for Counting Optical Quanta) comprises a linear array of 32 straight superconducting niobium nitride nanowires which span the mode of an optical fiber. This design supports high count rates with minimal penalties for detection efficiency and timing jitter. We show how these trade-offs can be mitigated by implementing independent read-out for each nanowire and by using a temporal walk correction technique to reduce count-rate dependent timing jitter. These detectors make quantum communication practical on a 10 GHz clock.


title: Milnor fibre homology complexes

abstract: Let $W$ be a finite Coxeter group. We give an algebraic presentation of what we refer to as ``the non-crossing algebra'', which is associated to the hyperplane complement of $W$ and to the cohomology of its Milnor fibre. This is used to produce simpler and more general chain (and cochain) complexes which compute the integral homology and cohomology groups of the Milnor fibre $F$ of $W$. In the process we define a new, larger algebra $\widetilde{A}$, which seems to be ``dual'' to the Fomin-Kirillov algebra, and in low ranks is linearly isomorphic to it. There is also a mysterious connection between $\widetilde{A}$ and the Orlik-Solomon algebra, in analogy with the fact that the Fomin-Kirillov algebra contains the coinvariant algebra of $W$. This analysis is applied to compute the multiplicities $\langle \rho, H^k(F,\mathbb{C})\rangle_W$ and $\langle \rho, H^k(M,\mathbb{C})\rangle_W$, where $M$ and $F$ are respectively the hyperplane complement and Milnor fibre associated to $W$ and $\rho$ is a representation of $W$.


title: Topological pump of $SU(Q)$ quantum chain and Diophantine equation

abstract: A topological pump of the $SU(Q)$ quantum chain is proposed associated with a current due to a local $[U(1)]^{\otimes Q}$ gauge invariance of colored fermions. The $SU(Q)$ invariant dimer phases are characterized by the $Z_Q$ Berry phases as a topological order parameter with a $d$-dimensional twist space ($d=Q-1$) as a synthetic Brillouin zone. By inclusion of the symmetry breaking perturbation specified by a rational parameter $\Phi=P/Q$, the pump, that encloses around the phase boundary, is characterized by the $Q$ Chern numbers associated with the currents due to uniform infinitesimal twists. The analysis of the systems under the open/periodic/twisted boundary conditions clarifies the bulk-edge correspondence of the pump where the large gauge transformation generated by the center of mass (CoM) plays a central role. An explicit formula for the Chern number is given by using the Diophanine equation. Numerical demonstration by the exact diagonalization and the DMRG for finite systems ($Q=3,4$ and $5$) have been presented to confirm the general discussions for low energy spectra, edge states, CoM's, Chern numbers and the bulk-edge correspondence. A modified Lieb-Schultz-Mattis type argument for the general $SU(Q)$ quantum chain is also mentioned.


title: Approaches to Identify Vulnerabilities to Misinformation: A Research Agenda

abstract: Given the prevalence of online misinformation and our scarce cognitive capacity, Internet users have been shown to frequently fall victim to such information. As some studies have investigated psychological factors that make people susceptible to believe or share misinformation, some ongoing research further put these findings into practice by objectively identifying when and which users are vulnerable to misinformation. In this position paper, we highlight two ongoing avenues of research to identify vulnerable users: detecting cognitive biases and exploring misinformation spreaders. We also discuss the potential implications of these objective approaches: discovering more cohorts of vulnerable users and prompting interventions to more effectively address the right group of users. Lastly, we point out two of the understudied contexts for misinformation vulnerability research as opportunities for future research.


title: Two-stage Stochastic Matching and Pricing with Applications to Ride Hailing

abstract: Matching and pricing are two critical levers in two-sided marketplaces to connect demand and supply. The platform can produce more efficient matching and pricing decisions by batching the demand requests. We initiate the study of the two-stage stochastic matching problem, with or without pricing, to enable the platform to make improved decisions in a batch with an eye toward the imminent future demand requests. This problem is motivated in part by applications in online marketplaces such as ride hailing platforms. We design online competitive algorithms for vertex-weighted (or unweighted) two-stage stochastic matching for maximizing supply efficiency, and two-stage joint matching and pricing for maximizing market efficiency. In the former problem, using a randomized primal-dual algorithm applied to a family of ``balancing'' convex programs, we obtain the optimal $3/4$ competitive ratio against the optimum offline benchmark. Using a factor revealing program and connections to submodular optimization, we improve this ratio against the optimum online benchmark to $(1-1/e+1/e^2)\approx 0.767$ for the unweighted and $0.761$ for the weighted case. In the latter problem, we design optimal $1/2$-competitive joint pricing and matching algorithm by borrowing ideas from the ex-ante prophet inequality literature. We also show an improved $(1-1/e)$-competitive algorithm for the special case of demand efficiency objective using the correlation gap of submodular functions. Finally, we complement our theoretical study by using DiDi's ride-sharing dataset for Chengdu city and numerically evaluating the performance of our proposed algorithms in practical instances of this problem.


title: Evolved Eclipsing Binaries and the Age of the Open Cluster NGC 752

abstract: We present analyses of improved photometric and spectroscopic observations for two detached eclipsing binaries at the turnoff of the open cluster NGC 752: the 1.01 day binary DS And and the 15.53 d BD $+$37 410. For DS And, we find $M_1 = 1.692\pm0.004\pm0.010 M_\odot$, $R_1 = 2.185\pm0.004\pm0.008 R_\odot$, $M_2 = 1.184\pm0.001\pm0.003 M_\odot$, and $R_2 = 1.200\pm0.003\pm0.005 R_\odot$. We either confirm or newly identify unusual characteristics of both stars in the binary: the primary star is found to be slightly hotter than the main sequence turn off and there is a more substantial discrepancy in its luminosity compared to models (model luminosities are too large by about 40%), while the secondary star is oversized and cooler compared to other main sequence stars in the same cluster. The evidence points to non-standard evolution for both stars, but most plausible paths cannot explain the low luminosity of the primary star. BD $+$37 410 only has one eclipse per cycle, but extensive spectroscopic observations and the TESS light curve constrain the stellar masses well: $M_1 = 1.717\pm0.011 M_\odot$ and $M_2 = 1.175\pm0.005 M_\odot$. The radius of the main sequence primary star near $2.9R_\odot$ definitively requires large convective core overshooting ($> 0.2$ pressure scale heights) in models for its mass, and multiple lines of evidence point toward an age of $1.61\pm0.03\pm0.05$ Gyr (statistical and systematic uncertainties). Because NGC 752 is currently undergoing the transition from non-degenerate to degenerate He ignition of its red clump stars, BD $+$37 410 A directly constrains the star mass where this transition occurs.


title: Stable finiteness does not imply linear soficity

abstract: We prove that there exist finitely generated, stably finite algebras which are non linear sofic. This was left open by Arzhantseva and P\u{a}unescu in 2017.


title: Neutron star mass formula with nuclear saturation parameters for asymmetric nuclear matter

abstract: Low-mass neutron stars are directly associated with the nuclear saturation parameters because their central density is definitely low. We have already found a suitable combination of nuclear saturation parameters for expressing the neutron star mass and gravitational redshift, i.e., $\eta\equiv (K_0L^2)^{1/3}$ with the incompressibility for symmetric nuclear matter, $K_0$, and the density-dependent nuclear symmetry energy, $L$. In this study, we newly find another suitable combination given by $\eta_\tau\equiv (-K_\tau L^5)^{1/6}$ with the isospin dependence of incompressibility for asymmetric nuclear matter, $K_\tau$, and derive the empirical relations for the neutron star mass and gravitational redshift as a function of $\eta_\tau$ and the normalized central number density. With these empirical relations, one can evaluate the mass and gravitational redshift of the neutron star, whose central number density is less than threefold the saturation density, within $\sim 10\%$ accuracy, and the radius within a few \% accuracies. In addition, we discuss the neutron star mass and radius constraints from the terrestrial experiments, using the empirical relations, together with those from the astronomical observations. Furthermore, we find a tight correlation between $\eta_\tau$ and $\eta$. With this correlation, we derive the constraint on $K_\tau$ as $-348\le K_\tau\le -237$ MeV, assuming that $L=60\pm 20$ and $K_0=240\pm 20$ MeV.


title: Motion Primitives Based Kinodynamic RRT for Autonomous Vehicle Navigation in Complex Environments

abstract: In this work, we have implemented a SLAM-assisted navigation module for a real autonomous vehicle with unknown dynamics. The navigation objective is to reach a desired goal configuration along a collision-free trajectory while adhering to the dynamics of the system. Specifically, we use LiDAR-based Hector SLAM for building the map of the environment, detecting obstacles, and for tracking vehicle's conformance to the trajectory as it passes through various states. For motion planning, we use rapidly exploring random trees (RRTs) on a set of generated motion primitives to search for dynamically feasible trajectory sequences and collision-free path to the goal. We demonstrate complex maneuvers such as parallel parking, perpendicular parking, and reversing motion by the real vehicle in a constrained environment using the presented approach.


title: PaCo: Parameter-Compositional Multi-Task Reinforcement Learning

abstract: The purpose of multi-task reinforcement learning (MTRL) is to train a single policy that can be applied to a set of different tasks. Sharing parameters allows us to take advantage of the similarities among tasks. However, the gaps between contents and difficulties of different tasks bring us challenges on both which tasks should share the parameters and what parameters should be shared, as well as the optimization challenges due to parameter sharing. In this work, we introduce a parameter-compositional approach (PaCo) as an attempt to address these challenges. In this framework, a policy subspace represented by a set of parameters is learned. Policies for all the single tasks lie in this subspace and can be composed by interpolating with the learned set. It allows not only flexible parameter sharing but also a natural way to improve training. We demonstrate the state-of-the-art performance on Meta-World benchmarks, verifying the effectiveness of the proposed approach.


title: Improved Normalizing Flow-Based Speech Enhancement using an All-pole Gammatone Filterbank for Conditional Input Representation

abstract: Deep generative models for Speech Enhancement (SE) received increasing attention in recent years. The most prominent example are Generative Adversarial Networks (GANs), while normalizing flows (NF) received less attention despite their potential. Building on previous work, architectural modifications are proposed, along with an investigation of different conditional input representations. Despite being a common choice in related works, Mel-spectrograms demonstrate to be inadequate for the given scenario. Alternatively, a novel All-Pole Gammatone filterbank (APG) with high temporal resolution is proposed. Although computational evaluation metric results would suggest that state-of-the-art GAN-based methods perform best, a perceptual evaluation via a listening test indicates that the presented NF approach (based on time domain and APG) performs best, especially at lower SNRs. On average, APG outputs are rated as having good quality, which is unmatched by the other methods, including GAN.


title: Safety-aware time-optimal motion planning with uncertain human state estimation

abstract: Human awareness in robot motion planning is crucial for seamless interaction with humans. Many existing techniques slow down, stop, or change the robot's trajectory locally to avoid collisions with humans. Although using the information on the human's state in the path planning phase could reduce future interference with the human's movements and make safety stops less frequent, such an approach is less widespread. This paper proposes a novel approach to embedding a human model in the robot's path planner. The method explicitly addresses the problem of minimizing the path execution time, including slowdowns and stops owed to the proximity of humans. For this purpose, it converts safety speed limits into configuration-space cost functions that drive the path's optimization. The costmap can be updated based on the observed or predicted state of the human. The method can handle deterministic and probabilistic representations of the human state and is independent of the prediction algorithm. Numerical and experimental results on an industrial collaborative cell demonstrate that the proposed approach consistently reduces the robot's execution time and avoids unnecessary safety speed reductions.


title: Evolutionary sparse data-driven discovery of complex multibody system dynamics

abstract: The value of unknown parameters of multibody systems is crucial for prediction, monitoring, and control, sometimes estimated using a biased physics-based model leading to incorrect outcomes. Discovering motion equations of multibody systems from time-series data is challenging as they consist of complex rational functions, constants as function arguments, and diverse function terms, which are not trivial to guess. This study aims at developing an evolutionary symbolic sparse regression approach for the system identification of multibody systems. The procedure discovers equations of motion and system parameters appearing as either constant values in function arguments or coefficients of function expressions. A genetic programming algorithm is written to generate symbolic function expressions, in which a hard-thresholding regression method is embedded. In an evolutionary manner, the complex functional forms, constant arguments, and unknown coefficients are identified to eventually discover the governing equation of a given system. A fitness measure is presented to promote parsimony in distilled equations and reduction in fit-to-data error. Hybrid discrete-continuous dynamical systems are also investigated, for which an approach is suggested to determine both mode number and system submodels. The performance and efficiency of the suggested evolutionary symbolic sparse regression methodology are evaluated in a simulation environment. The capability of the developed approach is also demonstrated by studying several multibody systems. The procedure is efficient and gives the possibility to estimate system parameters and distill respective governing equations. This technique reduces the risk that the function dictionary does not cover all functionality required to unravel hidden physical laws and the need for prior knowledge of the mechanism of interest.


title: MnEdgeNet -- Accurate Decomposition of Mixed Oxidation States for Mn XAS and EELS L2,3 Edges without Reference and Calibration

abstract: Accurate decomposition of the mixed Mn oxidation states is highly important for characterizing the electronic structures, charge transfer, and redox centers for electronic, electrocatalytic, and energy storage materials that contain Mn. Electron energy loss spectroscopy (EELS) and soft X-ray absorption spectroscopy (XAS) measurements of the Mn L2,3 edges are widely used for this purpose. To date, although the measurement of the Mn L2,3 edges is straightforward given the sample is prepared properly, an accurate decomposition of the mix valence states of Mn remains non-trivial. For both EELS and XAS, 2+, 3+, 4+ reference spectra need to be taken on the same instrument/beamline and preferably in the same experimental session because the instrumental resolution and the energy axis offset could vary from one session to another. To circumvent this hurdle, in this study, we adopted a deep learning approach and developed a calibration-free and reference-free method to decompose the oxidation state of Mn L2,3 edges for both EELS and XAS. To synthesize physics-informed and ground-truth labeled training datasets, we created a forward model that takes into account plural scattering, instrumentation broadening, noise, and energy axis offset. With that, we created a 1.2 million-spectrum database with a three-element oxidation state composition label. The library includes a sufficient variety of data including both EELS and XAS spectra. By training on this large database, our convolutional neural network achieves 85% accuracy on the validation dataset. We tested the model and found it is robust against noise (down to PSNR of 10) and plural scattering (up to t/{\lambda} = 1). We further validated the model against spectral data that were not used in training.

categories: cond-mat.mtrl-sci cs.AI cs.LG physics.chem-ph


title: A New Approach to Extract Fetal Electrocardiogram Using Affine Combination of Adaptive Filters

abstract: The detection of abnormal fetal heartbeats during pregnancy is important for monitoring the health conditions of the fetus. While adult ECG has made several advances in modern medicine, noninvasive fetal electrocardiography (FECG) remains a great challenge. In this paper, we introduce a new method based on affine combinations of adaptive filters to extract FECG signals. The affine combination of multiple filters is able to precisely fit the reference signal, and thus obtain more accurate FECGs. We proposed a method to combine the Least Mean Square (LMS) and Recursive Least Squares (RLS) filters. Our approach found that the Combined Recursive Least Squares (CRLS) filter achieves the best performance among all proposed combinations. In addition, we found that CRLS is more advantageous in extracting FECG from abdominal electrocardiograms (AECG) with a small signal-to-noise ratio (SNR). Compared with the state-of-the-art MSF-ANC method, CRLS shows improved performance. The sensitivity, accuracy, and F1 scores improved by 3.58%, 2.39%, and 1.36%, respectively.


title: Torsion points and concurrent exceptional curves on del Pezzo surfaces of degree one

abstract: The blow-up of the anticanonical base point on a del Pezzo surface $X$ of degree 1 gives rise to a rational elliptic surface $\mathscr{E}$ with only irreducible fibers. The sections of minimal height of $\mathscr{E}$ are in correspondence with the $240$ exceptional curves on $X$. A natural question arises when studying the configuration of these curves: if a point on $X$ is contained in 'many' exceptional curves, it is torsion on its fiber on $\mathscr{E}$? In 2005, Kuwata proved for the analogous question on del Pezzo surfaces of degree $2$, where there are 56 exceptional curves, that if 'many' equals $4$ or more, the answer is yes. In this paper, we prove that for del Pezzo surfaces of degree 1, the answer is yes if 'many' equals $9$ or more. Moreover, we give counterexamples where a \textsl{non}-torsion point lies in the intersection of $7$ exceptional curves. We give partial results for the still open case of 8 intersecting exceptional curves.


title: Learning Action Duration and Synergy in Task Planning for Human-Robot Collaboration

abstract: A good estimation of the actions' cost is key in task planning for human-robot collaboration. The duration of an action depends on agents' capabilities and the correlation between actions performed simultaneously by the human and the robot. This paper proposes an approach to learning actions' costs and coupling between actions executed concurrently by humans and robots. We leverage the information from past executions to learn the average duration of each action and a synergy coefficient representing the effect of an action performed by the human on the duration of the action performed by the robot (and vice versa). We implement the proposed method in a simulated scenario where both agents can access the same area simultaneously. Safety measures require the robot to slow down when the human is close, denoting a bad synergy of tasks operating in the same area. We show that our approach can learn such bad couplings so that a task planner can leverage this information to find better plans.


title: Nonlinear flip-flop quantum walks through potential barriers

abstract: The dynamics of nonlinear flip-flop quantum walk with amplitude-dependent phase shifts with pertubing potential barrier is investigated. Through the adjustment between uniform local perturbations and a Kerrlike nonlinearity of the medium we find a rich set of dynamic profiles. We will show the existence of different Hadamard quantum walking regimes, including those with mobile soliton-like structures or self-trapped states. The latter is predominant for perturbations with amplitudes that tend to $\varphi\rightarrow \pi/2$. In this system, the qubit shows an unusual behavior as we increase the amplitudes of the potential barriers, and displays a monotonic decrease in the self-trapping $\varphi_c$ with respect to the nonlinear parameter. A chaotic-like regime becomes predominant for intermediate nonlinearity values. Furthermore, we show that by changing the quantum coins ($\theta$) a non-trivial dynamic arises, where coins close to Pauli-X drives the system to a regime with predominant soliton-like structures, while the chaotic behavior are restricted to a narrow region in the $\chi$-$\varphi$ plane. We believe that is possible to implement and observe the proprieties of this model in a integrated photonic system.


title: Local Bayesian optimization via maximizing probability of descent

abstract: Local optimization presents a promising approach to expensive, high-dimensional black-box optimization by sidestepping the need to globally explore the search space. For objective functions whose gradient cannot be evaluated directly, Bayesian optimization offers one solution -- we construct a probabilistic model of the objective, design a policy to learn about the gradient at the current location, and use the resulting information to navigate the objective landscape. Previous work has realized this scheme by minimizing the variance in the estimate of the gradient, then moving in the direction of the expected gradient. In this paper, we re-examine and refine this approach. We demonstrate that, surprisingly, the expected value of the gradient is not always the direction maximizing the probability of descent, and in fact, these directions may be nearly orthogonal. This observation then inspires an elegant optimization scheme seeking to maximize the probability of descent while moving in the direction of most-probable descent. Experiments on both synthetic and real-world objectives show that our method outperforms previous realizations of this optimization scheme and is competitive against other, significantly more complicated baselines.


title: InfraRed Investigation in Singapore (IRIS) Observatory: Urban heat island contributors and mitigators analysis using neighborhood-scale thermal imaging

abstract: This paper studies heat fluxes from contributors and mitigators of urban heat islands using thermal images and weather data. Thermal images were collected from an observatory operating on the rooftop of a building between November 2021 and April 2022. Over the same period, an automatic weather station network was used to measure weather conditions at several locations on a university campus in Singapore. From data collected by the observatory and the automatic weather station network, a method was developed to estimate the heat emitted by building facades, vegetation, and traffic. Before performing the analysis of urban heat fluxes, it was observed that the surface temperature collected from the observatory is sensitive to some variables. After the sensitivity analysis, thermal images were calibrated against measurements of the surface temperature in an outdoor environment. Finally, several contributors and mitigators of urban heat islands were analyzed from heat fluxes assessed with thermal images and weather data. According to thermal images collected by the rooftop observatory, concrete walls are an important contributor to urban heat islands due to the longwave radiation they emit at night. Vegetation, on the other hand, seems to be an effective mitigator because of latent heat fluxes generated by evapotranspiration. Traffic looks to be a negligible source of heat if considered over a small portion of a road. In the future, more efforts can be made to estimate the magnitude of the heat released by an air-conditioning system from thermal images.


title: Promoting Rigour in Blockchains Energy & Environmental Footprint Research: A Systematic Literature Review

abstract: There is a growing interest in understanding the energy and environmental footprint of digital currencies, specifically in cryptocurrencies such as Bitcoin and Ethereum. These cryptocurrencies are operated by a geographically distributed network of computing nodes, making it hard to accurately estimate their energy consumption. Existing studies, both in academia and industry, attempt to model the cryptocurrencies energy consumption often based on a number of assumptions for instance about the hardware in use or geographic distribution of the computing nodes. A number of these studies has already been widely criticized for their design choices and subsequent over or under-estimation of the energy use. In this study, we evaluate the reliability of prior models and estimates by leveraging existing scientific literature from fields cognizant of blockchain such as social energy sciences and information systems. We first design a quality assessment framework based on existing research, we then conduct a systematic literature review examining scientific and non-academic literature demonstrating common issues and potential avenues of addressing these issues. Our goal with this article is to to advance the field by promoting scientific rigor in studies focusing on Blockchain's energy footprint. To that end, we provide a novel set of codes of conduct for the five most widely used research methodologies: quantitative energy modeling, literature reviews, data analysis \& statistics, case studies, and experiments. We envision that these codes of conduct would assist in standardizing the design and assessment of studies focusing on blockchain-based systems' energy and environmental footprint.


title: A Modal Decomposition Approach to Topological Wave Propagation

abstract: The characteristics of topologically protected wave propagation is typically predicted via the band structure of the primitive unit cell, using Berry curvature to predict localized interface or boundary states (as well as their degree of localization), and the dispersion relation to predict propagating group velocity. However, practical systems are finite in size and are driven by excitation with a finite bandwidth as guaranteed by the Fourier uncertainty principle. Hence, the dynamics predicted by the ideal infinite systems driven at a given frequency deviate from practical topological systems driven across a finite bandwidth. In this work, we demonstrate that the propagating topological waves in a valley Hall system can be interpreted using the underlying linear degenerate modal basis. We show that only a small subset of closely spaced modes with the appropriate phase differences comprise the topological waves, which enables the construction of analytical reduced-order models that accurately capture the topological wave. This result is related to the sparse density of the modal spectrum inside the topological band gap, which allows for the energy to be carried nearly completely by a narrow band of spectrally isolated eigenmodes that are spatially localized along the domain boundary. This finding is subsequently employed to predict the true group velocity of propagating topological waves with respect to input signal bandwidth and frequency by matching each active mode to corresponding band locations of the supercell dispersion diagram describing the semi-infinite system. Moreover, we demonstrate that damped topological waves may be studied within the framework of modal superposition by utilizing the damped modal spectrum to characterize the variation topological wave group velocity and predict edge-to-bulk transitions.


title: Doctors Handwritten Prescription Recognition System In Multi Language Using Deep Learning

abstract: Doctors typically write in incomprehensible handwriting, making it difficult for both the general public and some pharmacists to understand the medications they have prescribed. It is not ideal for them to write the prescription quietly and methodically because they will be dealing with dozens of patients every day and will be swamped with work.As a result, their handwriting is illegible. This may result in reports or prescriptions consisting of short forms and cursive writing that a typical person or pharmacist won't be able to read properly, which will cause prescribed medications to be misspelled. However, some individuals are accustomed to writing prescriptions in regional languages because we all live in an area with a diversity of regional languages. It makes analyzing the content much more challenging. So, in this project, we'll use a recognition system to build a tool that can translate the handwriting of physicians in any language. This system will be made into an application which is fully autonomous in functioning. As the user uploads the prescription image the program will pre-process the image by performing image pre-processing, and word segmentations initially before processing the image for training. And it will be done for every language we require the model to detect. And as of the deduction model will be made using deep learning techniques including CNN, RNN, and LSTM, which are utilized to train the model. To match words from various languages that will be written in the system, Unicode will be used. Furthermore, fuzzy search and market basket analysis are employed to offer an end result that will be optimized from the pharmaceutical database and displayed to the user as a structured output.


title: Gravitational scattering of the sterile neutrino halo dark matter

abstract: A recent study shows that gravitational scattering of dark matter, in the form of massive objects with mass $m \sim 10^3-10^4M_{\odot}$, could provide a possible solution to alleviate the small-scale structure problems of cold dark matter. The scattering cross section is velocity-dependent so that this scenario can explain why self-interaction of dark matter is significant in dwarf galaxies, but not in massive galaxies and galaxy clusters. In this Letter, we show that this kind of dark massive objects could be made of sterile neutrinos with a possible rest mass range $m_{\nu} \sim 7.6$ keV $-$ 71 MeV. This mass range generally satisfies most of the current observational constraints. The entire structure of the sterile neutrino halos can be simply predicted from standard physics.


title: RGB-Only Reconstruction of Tabletop Scenes for Collision-Free Manipulator Control

abstract: We present a system for collision-free control of a robot manipulator that uses only RGB views of the world. Perceptual input of a tabletop scene is provided by multiple images of an RGB camera (without depth) that is either handheld or mounted on the robot end effector. A NeRF-like process is used to reconstruct the 3D geometry of the scene, from which the Euclidean full signed distance function (ESDF) is computed. A model predictive control algorithm is then used to control the manipulator to reach a desired pose while avoiding obstacles in the ESDF. We show results on a real dataset collected and annotated in our lab.


title: Iterative Broadband Source Localization

abstract: In this paper we consider the problem of localizing a set of broadband sources from a finite window of measurements. In the case of narrowband sources this can be reduced to the problem of spectral line estimation, where our goal is simply to estimate the active frequencies from a weighted mixture of pure sinusoids. There exists a plethora of modern and classical methods that effectively solve this problem. However, for a wide variety of applications the underlying sources are not narrowband and can have an appreciable amount of bandwidth. In this work, we extend classical greedy algorithms for sparse recovery (e.g., orthogonal matching pursuit) to localize broadband sources. We leverage models for samples of broadband signals based on a union of Slepian subspaces, which are more aptly suited for dealing with spectral leakage and dynamic range disparities. We show that by using these models, our adapted algorithms can successfully localize broadband sources under a variety of adverse operating scenarios. Furthermore, we show that our algorithms outperform complementary methods that use more standard Fourier models. We also show that we can perform estimation from compressed measurements with little loss in fidelity as long as the number of measurements are on the order of the signal's implicit degrees of freedom. We conclude with an in-depth application of these ideas to the problem of localization in multi-sensor arrays.


title: SIT at MixMT 2022: Fluent Translation Built on Giant Pre-trained Models

abstract: This paper describes the Stevens Institute of Technology's submission for the WMT 2022 Shared Task: Code-mixed Machine Translation (MixMT). The task consisted of two subtasks, subtask $1$ Hindi/English to Hinglish and subtask $2$ Hinglish to English translation. Our findings lie in the improvements made through the use of large pre-trained multilingual NMT models and in-domain datasets, as well as back-translation and ensemble techniques. The translation output is automatically evaluated against the reference translations using ROUGE-L and WER. Our system achieves the $1^{st}$ position on subtask $2$ according to ROUGE-L, WER, and human evaluation, $1^{st}$ position on subtask $1$ according to WER and human evaluation, and $3^{rd}$ position on subtask $1$ with respect to ROUGE-L metric.


title: The Rest-Frame Submillimeter Spectrum of High Redshift, Dusty, Star-Forming Galaxies from the SPT-SZ Survey

abstract: We present the average rest-frame spectrum of the final catalog of dusty star-forming galaxies (DSFGs) selected from the South Pole Telescope SZ survey (SPT-SZ) and measured with Band 3 of the Atacama Large Millimeter/submillimeter Array (ALMA). This work builds on the previous average rest-frame spectrum, given in Spilker et al. (2014) for the first 22 sources, and is comprised of a total of 78 sources, normalized by their respective apparent dust masses. The spectrum spans $1.9$$<$z$<$$6.9$ and covers rest-frame frequencies of 240$-$800 GHz. Combining this data with low-J CO observations from the Australia Telescope Compact Array (ATCA), we detect multiple bright line features from $^{12}$CO, $[$CI$]$, and H$_2$O, as well as fainter molecular transitions from $^{13}$CO, HCN, HCO$^+$, HNC, CN, H$_2$O$^+$, and CH. We use these detections, along with limits from other molecules, to characterize the typical properties of the interstellar medium (ISM) for these high redshift DSFGs. We are able to divide the large sample into subsets in order to explore how the average spectrum changes with various galaxy properties, such as effective dust temperature. We find that systems with hotter dust temperatures exhibit differences in the bright $^{12}$CO emission lines, and contain either warmer and more excited dense gas tracers, or larger dense gas reservoirs. These observations will serve as a reference point to studies of the ISM in distant luminous DSFGs (L$_{\mathrm{IR}}$$>$$10^{12}$L$_\odot$), and will inform studies of chemical evolution before the peak epoch of star formation at $z=2-3$.


title: Stochastic Adaptive Activation Function

abstract: The simulation of human neurons and neurotransmission mechanisms has been realized in deep neural networks based on the theoretical implementations of activation functions. However, recent studies have reported that the threshold potential of neurons exhibits different values according to the locations and types of individual neurons, and that the activation functions have limitations in terms of representing this variability. Therefore, this study proposes a simple yet effective activation function that facilitates different thresholds and adaptive activations according to the positions of units and the contexts of inputs. Furthermore, the proposed activation function mathematically exhibits a more generalized form of Swish activation function, and thus we denoted it as Adaptive SwisH (ASH). ASH highlights informative features that exhibit large values in the top percentiles in an input, whereas it rectifies low values. Most importantly, ASH exhibits trainable, adaptive, and context-aware properties compared to other activation functions. Furthermore, ASH represents general formula of the previously studied activation function and provides a reasonable mathematical background for the superior performance. To validate the effectiveness and robustness of ASH, we implemented ASH into many deep learning models for various tasks, including classification, detection, segmentation, and image generation. Experimental analysis demonstrates that our activation function can provide the benefits of more accurate prediction and earlier convergence in many deep learning applications.


title: Strategies and Vulnerabilities of Participants in Venezuelan Influence Operations

abstract: Studies of online influence operations, coordinated efforts to disseminate and amplify disinformation, focus on forensic analysis of social networks or of publicly available datasets of trolls and bot accounts. However, little is known about the experiences and challenges of human participants in influence operations. We conducted semi-structured interviews with 19 influence operations participants that contribute to the online image of Venezuela, to understand their incentives, capabilities, and strategies to promote content while evading detection. To validate a subset of their answers, we performed a quantitative investigation using data collected over almost four months, from Twitter accounts they control. We found diverse participants that include pro-government and opposition supporters, operatives and grassroots campaigners, and sockpuppet account owners and real users. While pro-government and opposition participants have similar goals and promotion strategies, they differ in their motivation, organization, adversaries and detection avoidance strategies. We report the Patria framework, a government platform for operatives to log activities and receive benefits. We systematize participant strategies to promote political content, and to evade and recover from Twitter penalties. We identify vulnerability points associated with these strategies, and suggest more nuanced defenses against influence operations.