title: Deblurring using Analysis-Synthesis Networks Pair

abstract: Blind image deblurring remains a challenging problem for modern artificial neural networks. Unlike other image restoration problems, deblurring networks fail behind the performance of existing deblurring algorithms in case of uniform and 3D blur models. This follows from the diverse and profound effect that the unknown blur-kernel has on the deblurring operator. We propose a new architecture which breaks the deblurring network into an analysis network which estimates the blur, and a synthesis network that uses this kernel to deblur the image. Unlike existing deblurring networks, this design allows us to explicitly incorporate the blur-kernel in the network's training. In addition, we introduce new cross-correlation layers that allow better blur estimations, as well as unique components that allow the estimate blur to control the action of the synthesis deblurring action. Evaluating the new approach over established benchmark datasets shows its ability to achieve state-of-the-art deblurring accuracy on various tests, as well as offer a major speedup in runtime.


title: Gender-specific behavior change following terror attacks

abstract: Terrorists use violence in pursuit of political goals. While terror often has severe consequences for victims, it remains an open question how terror attacks affect the general population. We study the behavioral response of citizens of cities affected by $7$ different terror attacks. We compare real-time mobile communication patterns in the first $24$ hours following a terror attack to the corresponding patterns on days with no terror attack. On ordinary days, the group of female and male participants have different activity patterns. Following a terror attack, however, we observe a significant increase of the gender differences. Knowledge about citizens' behavior response patterns following terror attacks may have important implications for the public response during and after an attack.


title: TSInsight: A local-global attribution framework for interpretability in time-series data

abstract: With the rise in the employment of deep learning methods in safety-critical scenarios, interpretability is more essential than ever before. Although many different directions regarding interpretability have been explored for visual modalities, time-series data has been neglected with only a handful of methods tested due to their poor intelligibility. We approach the problem of interpretability in a novel way by proposing TSInsight where we attach an auto-encoder to the classifier with a sparsity-inducing norm on its output and fine-tune it based on the gradients from the classifier and a reconstruction penalty. TSInsight learns to preserve features that are important for prediction by the classifier and suppresses those that are irrelevant i.e. serves as a feature attribution method to boost interpretability. In contrast to most other attribution frameworks, TSInsight is capable of generating both instance-based and model-based explanations. We evaluated TSInsight along with 9 other commonly used attribution methods on 8 different time-series datasets to validate its efficacy. Evaluation results show that TSInsight naturally achieves output space contraction, therefore, is an effective tool for the interpretability of deep time-series models.


title: Unresolved sideband photon recoil spectroscopy of molecular ions

abstract: We reflect on the prospect of exploiting the recoil associated with absorption and emission of photons to perform spectroscopy of a single molecular ion. For this recoil to be detectable, the molecular ion is sympathetically cooled by a laser-cooled atomic ion to near their common quantum mechanical ground state within a trapping potential. More specifically, we present a general framework for simulating the expected photon recoil spectra in regimes where either the natural transition linewidth $\Gamma_t$ of the molecular ion or the spectral width $\Gamma_L$ of the exciting light source exceeds the motional frequencies of the two-ion system. To exemplify the framework, we present two complementary cases: spectroscopy of the broad 3s $^2$S$_{1/2}$ - 3p $^2$P$_{3/2}$ electronic transition ($\Gamma_t/2\pi = 41.8$ MHz) of a single $^{24}$Mg$^+$ ion at $\lambda=279.6$ nm by a narrow laser source ($\Gamma_L/2\pi \lesssim 1$ MHz) and mid-infrared vibrational spectroscopy of the very narrow $|v=0,J=1\rangle$ - $|v'=1,J'=0\rangle$ transition ($\Gamma_t/2\pi = 2.50 $ Hz) at $\lambda=6.17$ $\mu$m in the $^1\Sigma^+$ electronic ground state of $^{24}$MgH$^+$ by a broadband laser source ($\Gamma_L/2\pi \gtrsim$ 50 MHz). The atomic ion $^{24}$Mg$^+$ has been picked to introduce a simple system to make comparisons with experimental results while still capturing most of the physics involved in electronic excitations of molecular ions.


title: Large-scale asymmetry between clockwise and counterclockwise galaxies revisited

abstract: The ability of digital sky surveys to collect and store very large amounts of data provides completely new ways to study the local universe. Perhaps one of the most provocative observations reported with such tools is the asymmetry between galaxies with clockwise and counterclockwise spin patterns. Here I use $\sim1.7\cdot10^5$ spiral galaxies from SDSS and sort them by their spin patterns (clockwise or counterclockwise) to identify and profile a possible large-scale pattern of the distribution of galaxy spin patterns as observed from Earth. The analysis shows asymmetry between the number of clockwise and counterclockwise spiral galaxies imaged by SDSS, and a dipole axis. These findings largely agree with previous reports using smaller datasets. The probability of the differences between the number of galaxies to occur by chance is (P<4*10^-9), and the probability of an asymmetry axis to occur by mere chance is (P<1.4*10^-5).


title: Localized Excitons in NbSe$_2$-MoSe$_2$ Heterostructures

abstract: Neutral and charged excitons (trions) in atomically-thin materials offer important capabilities for photonics, from ultrafast photodetectors to highly-efficient light-emitting diodes and lasers. Recent studies of van der Waals (vdW) heterostructures comprised of dissimilar monolayer materials have uncovered a wealth of optical phenomena that are predominantly governed by interlayer interactions. Here, we examine the optical properties in NbSe$_2$ - MoSe$_2$ vdW heterostructures, which provide an important model system to study metal-semiconductor interfaces, a common element in optoelectronics. Through low-temperature photoluminescence (PL) microscopy we discover a sharp emission feature, L1, that is localized at the NbSe$_2$-capped regions of MoSe$_2$. L1 is observed at energies below the commonly-studied MoSe$_2$ excitons and trions, and exhibits temperature- and power-dependent PL consistent with exciton localization in a confining potential. Remarkably, L1 is very robust not just in different samples, but also under a variety of fabrication processes. Using first-principles calculations we reveal that the confinement potential required for exciton localization naturally arises from the in-plane band bending due to the changes in the electron affinity between pristine MoSe$_2$ and NbSe$_2$ - MoSe$_2$ heterostructure. We discuss the implications of our studies for atomically-thin optoelectronics devices with atomically-sharp interfaces and tunable electronic structures.


title: The SDSS-HET Survey of Kepler Eclipsing Binaries. Description of the Survey and First Results

abstract: The Kepler mission has provided a treasure trove of eclipsing binaries (EBs), observed at extremely high photometric precision, nearly continuously for several years. We are carrying out a survey of ~100 of these EBs to derive dynamical masses and radii with precisions of 3% or better. We use multiplexed near-infrared H band spectroscopy from the SDSS-III and -IV APOGEE instrument and optical spectroscopy from the HET High-Resolution Spectrograph to derive double-lined spectroscopic orbits and dynamical mass-ratios for the EB sample. This information is combined with Kepler photometry to derive orbital inclination, dynamical masses of the components, radii and temperatures. These measurements are directly applicable for benchmarking stellar models that are integrating the next generation of improvements, such as the magnetic suppression of convection efficiency, updated opacity tables, and fine-tuned equations of state. We selected our EB sample to include systems with low-mass ($M \lt 0.8 \; M_{\odot}$) primary or secondary components, many expected to populate the relatively sparse parameter space below $0.5 \; M_{\odot}$. In this paper, we describe our EB sample and the analysis techniques we are utilizing, and present masses and radii for two systems that inhabit particularly underpopulated regions of mass-radius-period space: KIC 2445134 and KIC 3003991. Our analysis of KIC 2445134 ($q=0.411 \pm 0.001$) yields masses and radii of $M_A = 1.29 \pm 0.03 \; M_{\odot}$, $M_B = 0.53 \pm 0.01 \; M_{\odot}$, $R_A = 1.42 \pm 0.01 \; R_{\odot}$, $R_B = 0.510 \pm 0.004 \; R_{\odot}$, and a temperature ratio of $T_B/T_A = 0.635 \pm 0.001$; our analysis of KIC 3003991 ($q=0.298 \pm 0.006$) yields $M_A = 0.74 \pm \; 0.04 M_{\odot}$, $M_B = 0.222 \pm \; 0.007 M_{\odot}$, $R_A = 0.84 \pm 0.01 \; R_{\odot}$, $R_B = 0.250 \pm 0.004 \; R_{\odot}$, and a temperature ratio of $T_B/T_A= 0.662 \pm 0.001$.


title: Multipole alignment in the large-scale distribution of spin direction of spiral galaxies

abstract: Previous observations have suggested non-random distribution of spin directions of galaxies at scales far larger than the size of a supercluster. Here I use $\sim1.7\cdot10^5$ spiral galaxies from SDSS and $3.3\cdot10^4$ spiral galaxies from Pan-STARRS to analyze the distribution of galaxy spin patterns of spiral galaxies as observed from Earth. The analysis shows in both SDSS and Pan-STARRS that the distribution of galaxy spin directions forms a non-random pattern, and can be fitted to a dipole axis in probability much higher than mere chance. These observations agree with previous findings, but are based on more data and two different telescopes. The analysis also shows that the distribution of galaxy spin directions fits a large-scale multipole alignment, with best fit to quadrupole alignment with probability of $\sim6.9\sigma$ to have such distribution by chance. Comparison of two separate datasets from SDSS and Pan-STARRS such that the galaxies in both datasets have similar redshift distribution provides nearly identical quadrupole patterns.


title: Realization of Nearly Dispersionless Bands with Strong Orbital Anisotropy from Destructive Interference in Twisted Bilayer MoS2

abstract: Recently, the twist angle between adjacent sheets of stacked van der Waals materials emerged as a new knob to engineer correlated states of matter in two-dimensional heterostructures in a controlled manner, giving rise to emergent phenomena such as superconductivity or correlated insulating states. Here,we use an ab initio based approach to characterize the electronic properties of twisted bilayer MoS2. We report that, in marked contrast to twisted bilayer graphene, slightly hole-doped MoS2 realizes a strongly asymmetric px-py Hubbard model on the honeycomb lattice, with two almost entirely dispersionless bands emerging due to destructive interference. We study the collective behavior of twisted bilayer MoS2 in the presence of interactions, and characterize an array of different magnetic and orbitally-ordered correlated phases,which may be susceptible to quantum fluctuations giving rise to exotic, purely quantum, states of matter.


title: TSception: A Deep Learning Framework for Emotion Detection Using EEG

abstract: In this paper, we propose a deep learning framework, TSception, for emotion detection from electroencephalogram (EEG). TSception consists of temporal and spatial convolutional layers, which learn discriminative representations in the time and channel domains simultaneously. The temporal learner consists of multi-scale 1D convolutional kernels whose lengths are related to the sampling rate of the EEG signal, which learns multiple temporal and frequency representations. The spatial learner takes advantage of the asymmetry property of emotion responses at the frontal brain area to learn the discriminative representations from the left and right hemispheres of the brain. In our study, a system is designed to study the emotional arousal in an immersive virtual reality (VR) environment. EEG data were collected from 18 healthy subjects using this system to evaluate the performance of the proposed deep learning network for the classification of low and high emotional arousal states. The proposed method is compared with SVM, EEGNet, and LSTM. TSception achieves a high classification accuracy of 86.03%, which outperforms the prior methods significantly (p<0.05). The code is available at https://github.com/deepBrains/TSception


title: On Conserved Quantities for the Free Motion of Particles with Spin

abstract: In the early 80's, R. R\"{u}diger published a pair of articles in which it was found the most general conserved charges associated to the motion of particles with spin moving in curved spacetime. In particular, it was shown that besides the well-known conserved quantity associated to Killing vectors, it is also possible to have another conserved quantity that is linear in the spin of the particle if the spacetime admits a Killing-Yano tensor. However, in these papers it was proved that in order for this new scalar to be conserved two obscure conditions involving the Killing-Yano tensor and the curvature must be obeyed. In the present paper we try to shed light over these conditions and end up proving that this conserved quantity is useless for most physically relevant spacetimes. Notably, for particles moving in vacuum (Einstein spacetimes) this conserved scalar constructed with the Killing-Yano tensor will not help on the integration of the equations of motion. Moreover, we prove that, as a consequence of these obscure conditions, the Killing-Yano tensor must be covariantly constant.


title: Evolving Normalization-Activation Layers

abstract: Normalization layers and activation functions are fundamental components in deep networks and typically co-locate with each other. Here we propose to design them using an automated approach. Instead of designing them separately, we unify them into a single tensor-to-tensor computation graph, and evolve its structure starting from basic mathematical functions. Examples of such mathematical functions are addition, multiplication and statistical moments. The use of low-level mathematical functions, in contrast to the use of high-level modules in mainstream NAS, leads to a highly sparse and large search space which can be challenging for search methods. To address the challenge, we develop efficient rejection protocols to quickly filter out candidate layers that do not work well. We also use multi-objective evolution to optimize each layer's performance across many architectures to prevent overfitting. Our method leads to the discovery of EvoNorms, a set of new normalization-activation layers with novel, and sometimes surprising structures that go beyond existing design patterns. For example, some EvoNorms do not assume that normalization and activation functions must be applied sequentially, nor need to center the feature maps, nor require explicit activation functions. Our experiments show that EvoNorms work well on image classification models including ResNets, MobileNets and EfficientNets but also transfer well to Mask R-CNN with FPN/SpineNet for instance segmentation and to BigGAN for image synthesis, outperforming BatchNorm and GroupNorm based layers in many cases.


title: The $\gamma$-ray sky seen at X-ray energies I. Searching for the connection between X-rays and $\gamma$-rays in Fermi BL Lac objects

abstract: BL Lac objects are an extreme type of active galactic nuclei (AGNs) that belong to the largest population of $\gamma$-ray sources: blazars. This class of AGNs shows a double-bumped spectral energy distribution that is commonly described in terms of a synchrotron self-Compton (SSC) emission process, whereas the low-energy component that dominates their emission between the infrared and the X-ray band is tightly connected to the high-energy component that peaks in the $\gamma$-rays. Two strong connections that link radio and mid-infrared emission of blazars to the emission in the $\gamma$-ray band are well established. They constitute the basis for associating $\gamma$-ray sources with their low-energy counterparts. We searched for a possible link between X-ray and $\gamma$-ray emissions for the subclass of BL Lacs using all archival Swift/XRT observations combined with Fermi data for a selected sample of 351 sources. Analyzing $\sim$2400 ks of Swift/XRT observations that were carried out until December 2018, we discovered that above the $\gamma$-ray flux threshold $F_{\gamma}\approx3\times10^{-12}\,\rm{erg}\,\rm{cm}^{-2}\,\rm{s}^{-1}$, 96\% of all \emph{Fermi} BL Lacs have an X-ray counterpart that is detected with signal-to-noise ratio higher than 3. We did not find any correlation or clear trend between X-ray and $\gamma$-ray fluxes and/or spectral shapes, but we discovered a correlation between the X-ray flux and the mid-infrared color. Finally, we discuss on a possible interpretation of our results in the SSC framework.


title: Deciphering the Large-Scale Environment of Radio Galaxies in the Local Universe II. A Statistical Analysis of Environmental Properties

abstract: In our previous analysis we investigated the large-scale environment of two samples of radio galaxies (RGs) in the local Universe (i.e. with redshifts z<0.15), classified as FR I and FR II on the basis of their radio morphology. The analysis was carried out using i) extremely homogeneous catalogs and ii) a new method, known as cosmological overdensity, to investigate their large-scale environments. We concluded that, independently by the shape of their radio extended structure, RGs inhabit galaxy-rich large-scale environments with similar characteristics and richness. In the present work, we first highlight additional advantages of our procedure, that does not suffer cosmological biases and/or artifacts, and then we carry out an additional statistical test to strengthen our previous results. We also investigate properties of RG environments using those of the cosmological neighbors. We find that large-scale environments of both FRIs and FRIIs are remarkably similar and independent on the properties of central RG. Finally, we highlight the importance of comparing radio sources in the same redshift bins to obtain a complete overview of their large-scale environments.


title: Transverse spinning of unpolarized light

abstract: It is well known that spin angular momentum of light, and therefore that of photons, is directly related to their circular polarization. Naturally, for totally unpolarized light, polarization is undefined and the spin vanishes. However, for nonparaxial light, the recently discovered transverse spin component, orthogonal to the main propagation direction, is largely independent of the polarization state of the wave. Here we demonstrate, both theoretically and experimentally, that this transverse spin survives even in nonparaxial fields (e.g., tightly focused or evanescent) generated from a totally unpolarized light source. This counterintuitive phenomenon is closely related to the fundamental difference between the degrees of polarization for 2D paraxial and 3D nonparaxial fields. Our results open an avenue for studies of spin-related phenomena and optical manipulation using unpolarized light.


title: Accessory Parameters for Four-Punctured Spheres

abstract: We study the accessory parameter problem for four-punctured spheres from the point of view of modular forms. The value of the accessory parameter giving the uniformization is characterized as the unique zero of a system of equations. This gives an effective method to compute the uniformizing differential equation. As an application, we compute numerically and study the local expansion of the real-analytic function associating to a four-punctured sphere the value of its uniformizing parameter, and make some observations on its coefficients.


title: Particle Identification Using Boosted Decision Trees in the Semi-Digital Hadronic Calorimeter Prototype

abstract: The CALICE Semi-Digital Hadronic CALorimeter (SDHCAL) prototype using Glass Resistive Plate Chambers as a sensitive medium is the first technological prototype of a family of high-granularity calorimeters developed by the CALICE collaboration to equip the experiments of future leptonic colliders. It was exposed to beams of hadrons, electrons and muons several times in the CERN PS and SPS beamlines between 2012 and 2018. We present here a new method of particle identification within the SDHCAL using the Boosted Decision Trees (BDT) method applied to the data collected in 2015. The performance of the method is tested first with Geant4-based simulated events and then on the data collected by the SDHCAL in the energy range between 10 and 80~GeV with 10~GeV energy steps. The BDT method is then used to reject the electrons and muons that contaminate the SPS hadron beams.


title: Predicting Strategic Behavior from Free Text

abstract: The connection between messaging and action is fundamental both to web applications, such as web search and sentiment analysis, and to economics. However, while prominent online applications exploit messaging in natural (human) language in order to predict non-strategic action selection, the economics literature focuses on the connection between structured stylized messaging to strategic decisions in games and multi-agent encounters. This paper aims to connect these two strands of research, which we consider highly timely and important due to the vast online textual communication on the web. Particularly, we introduce the following question: can free text expressed in natural language serve for the prediction of action selection in an economic context, modeled as a game? In order to initiate the research on this question, we introduce the study of an individual's action prediction in a one-shot game based on free text he/she provides, while being unaware of the game to be played. We approach the problem by attributing commonsensical personality attributes via crowd-sourcing to free texts written by individuals, and employing transductive learning to predict actions taken by these individuals in one-shot games based on these attributes. Our approach allows us to train a single classifier that can make predictions with respect to actions taken in multiple games. In experiments with three well-studied games, our algorithm compares favorably with strong alternative approaches. In ablation analysis, we demonstrate the importance of our modeling choices---the representation of the text with the commonsensical personality attributes and our classifier---to the predictive power of our model.


title: Successive Eigenvalue Removal for Multi-Soliton Spectral Amplitude Estimation

abstract: Optical nonlinear Fourier transform-based communication systems require an accurate estimation of a signal's nonlinear spectrum, computed usually by piecewise approximation methods on the signal samples. We propose an algorithm, named successive eigenvalue removal, to improve the spectrum estimation of a multi-soliton pulse. It exploits a property of the Darboux transform that allows removing eigenvalues from the nonlinear spectrum. This results in a smaller pulse duration and smaller bandwidth. The spectral coefficients are estimated successively after removing the eigenvalues of a signal. As a beneficial application, we show that the algorithm decreases the computational complexity by iteratively reducing the pulse duration.


title: Swarm robotics and complex behaviour of continuum material

abstract: In swarm robotics, just as for an animal swarm in Nature, one of the aims is to reach and maintain a desired configuration. One of the possibilities for the team, to reach this aim, is to see what its neighbours are doing. This approach generates a rules system governing the movement of the single robot just by reference to neighbour's motion. The same approach is used in position based dynamics to simulate behaviour of complex continuum materials under deformation. Therefore, in some previous works, we have considered a two-dimensional lattice of particles and calculated its time evolution by using a rules system derived from our experience in swarm robotics. The new position of a particle, like the element of a swarm, is determined by the spatial position of the other particles. No dynamic is considered, but it can be thought as being hidden in the behaviour rules. This method has given good results in some simple situations reproducing the behaviour of deformable bodies under imposed strain. In this paper we try to stress our model to highlight its limits and how they can be improved. Some other, more complex, examples are computed and discussed. Shear test, different lattice, different fracture mechanism and ASTM shape sample behaviour have been investigated by the software tool we have developed.


title: A catalog of interesting and useful Lambert series identities

abstract: A Lambert series generating function is a special series summed over an arithmetic function $f$ defined by \[ L_f(q) := \sum_{n \geq 1} \frac{f(n) q^n}{1-q^n} = \sum_{m \geq 1} (f \ast 1)(m) q^m. \] Because of the way the left-hand-side terms of this type of generating function generate divisor sums of $f$ convolved by Dirichlet convolution with one, these expansions are natural ways to enumerate the ordinary generating functions of many multiplicative special functions in number theory. We present an overview of key properties of Lambert series generating function expansions, their more combinatorial generalizations, and include a compendia of tables illustrating known formulas for special cases of these series. In this sense, we focus more on the formal properties of the sequences that are enumerated by the Lambert series, and do not spend significant time treating these series as analytic objects subject to rigorous convergence constraints. The first question one might ask before reading this document is: Why has is catalog of interesting Lambert series identities compiled? As with the indispensible reference by H. W. Gould and T. Shonhiwa, A catalog of interesting Dirichlet series, for Dirichlet series (DGF) identities, there are many situations in which one needs a summary reference on Lambert series and their properties. New work has been done recently tying Lambert series expansions to partition functions by expansions of their generating functions. In addition to these new expansions and providing an introduction to Lambert series, we have listings of classically relevant and "odds and ends'' examples for Lambert series summations that are occasionally useful in applications. If you see any topics or identities the author has missed, please contact us over email to append to this reference.


title: Spatially multiplexed picosecond pulse-train generation in a 6-LP-mode fiber based on multiple four-wave-mixings

abstract: We report on the generation of four spatially multiplexed picosecond 40-GHz pulse trains in a km-long 6-LP multimode optical fiber. The principle of operation is based on the parallel nonlinear compression of initial beat-signals into well separated pulse trains owing to intra-modal multiple four-wave mixings. A series of four 40-GHz dual-frequency beatings at different wavelengths are simultaneously injected into the LP01, LP11, LP02 and LP12 modes of a 1.8-km long graded-index few-mode fiber. The combined effects of Kerr nonlinearity and anomalous chromatic dispersion lead to the simultaneous generation of four spatially multiplexed frequency combs which correspond in the temporal domain to the compression of these beat-signals into picosecond pulses. The temporal profiles of the output pulse-trains demultiplexed from each spatial mode show that well-separated picosecond pulses with negligible pedestals are then generated.


title: Symplectic keys and Demazure atoms in type C

abstract: We compute, mimicking the Lascoux-Sch\"utzenberger type A combinatorial procedure, left and right keys for a Kashiwara-Nakashima tableau in type C. These symplectic keys have a similar role as the keys for semistandard Young tableaux. More precisely, our symplectic keys give a tableau criterion for the Bruhat order on the hyperoctahedral group and cosets, and describe Demazure atoms and characters in type C. The right and the left symplectic keys are related through the Lusztig involution. A type C Sch\"utzenberger evacuation is defined to realize that involution.


title: Complexity iteration analysis for strongly convex multi-objective optimization using a Newton path-following procedure

abstract: In this note we consider the iteration complexity of solving strongly convex multi objective optimization. We discuss the precise meaning of this problem, and indicate it is loosely defined, but the most natural notion is to find a set of Pareto optimal points across a grid of scalarized problems. We derive that in most cases, performing sensitivity based path-following after obtaining one solution is the optimal strategy for this task in terms of iteration complexity.


title: LUVLi Face Alignment: Estimating Landmarks' Location, Uncertainty, and Visibility Likelihood

abstract: Modern face alignment methods have become quite accurate at predicting the locations of facial landmarks, but they do not typically estimate the uncertainty of their predicted locations nor predict whether landmarks are visible. In this paper, we present a novel framework for jointly predicting landmark locations, associated uncertainties of these predicted locations, and landmark visibilities. We model these as mixed random variables and estimate them using a deep network trained with our proposed Location, Uncertainty, and Visibility Likelihood (LUVLi) loss. In addition, we release an entirely new labeling of a large face alignment dataset with over 19,000 face images in a full range of head poses. Each face is manually labeled with the ground-truth locations of 68 landmarks, with the additional information of whether each landmark is unoccluded, self-occluded (due to extreme head poses), or externally occluded. Not only does our joint estimation yield accurate estimates of the uncertainty of predicted landmark locations, but it also yields state-of-the-art estimates for the landmark locations themselves on multiple standard face alignment datasets. Our method's estimates of the uncertainty of predicted landmark locations could be used to automatically identify input images on which face alignment fails, which can be critical for downstream tasks.


title: Gamow Shell Model description of Li isotopes and their mirror partners

abstract: Background: Weakly bound and unbound nuclei close to particle drip lines are laboratories of new nuclear structure physics at the extremes of neutron/proton excess. The comprehensive description of these systems requires an open quantum system framework that is capable of treating resonant and nonresonant many-body states on equal footing. Purpose: In this work, we construct the minimal complex-energy configuration interaction approach to describe binding energies and spectra of selected 5 $\leq$ A $\leq$ 11 nuclei. Method: We employ the complex-energy Gamow shell model (GSM) assuming a rigid $^4$He core. The effective Hamiltonian, consisting of a core-nucleon Woods-Saxon potential and a simplified version of the Furutani-Horiuchi-Tamagaki interaction with the mass-dependent scaling, is optimized in the sp space. To diagonalize the Hamiltonian matrix, we employ the Davidson method and the Density Matrix Renormalization Group technique. Results: Our optimized GSM Hamiltonian offers a good reproduction of binding energies and spectra with the root-mean-square (rms) deviation from experiment of 160 keV. Since the model performs well when used to predict known excitations that have not been included in the fit, it can serve as a reliable tool to describe poorly known states. A case in point is our prediction for the pair of unbound mirror nuclei $^{10}$Li-$^{10}$N in which a huge Thomas-Ehrman shift dramatically alters the pattern of low-energy excitations. Conclusion: The new model will enable comprehensive studies of structure and reactions aspects of light drip-line nuclei.


title: Electronic Band Structures of Pristine and Chemically Modified Cellulose Allomorphs

abstract: We have investigated the structural properties, vibrational spectra, and electronic band structures of crystalline cellulose allomorphs and chemically modified cellulose with quantum chemical methods. The electronic band gaps of cellulose allomorphs I$_\alpha$, I$_\beta$, II, and III$_1$ lie in the range of 5.0 to 5.6 eV. We show that extra states can be created in the band gap of cellulose by chemical modification. Experimentally feasible amidation of cellulose I$_\beta$ with aniline or 4,4'- diaminoazobenzene creates narrow bands in the cellulose band gap, reducing the difference between the occupied and empty states to 4.0 or 1.8 eV, respectively. The predicted states 4,4'-diaminoazobenzene-modified cellulose I$_\beta$ fall in the visible spectrum, suggesting uses in optical applications.


title: Integrating Owicki-Gries for C11-Style Memory Models into Isabelle/HOL

abstract: Weak memory presents a new challenge for program verification and has resulted in the development of a variety of specialised logics. For C11-style memory models, our previous work has shown that it is possible to extend Hoare logic and Owicki-Gries reasoning to verify correctness of weak memory programs. The technique introduces a set of high-level assertions over C11 states together with a set of basic Hoare-style axioms over atomic weak memory statements (e.g., reads/writes), but retains all other standard proof obligations for compound statements. This paper takes this line of work further by showing Nipkow and Nieto's encoding of Owicki-Gries in the Isabelle theorem prover can be extended to handle C11-style weak memory models in a straightforward manner. We exemplify our techniques over several litmus tests from the literature and a non-trivial example: Peterson's algorithm adapted for C11. For the examples we consider, the proof outlines can be automatically discharged using the existing Isabelle tactics developed by Nipkow and Nieto. The benefit here is that programs can be written using a familiar pseudocode syntax with assertions embedded directly into the program.


title: MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

abstract: Natural Language Processing (NLP) has recently achieved great success by using huge pre-trained models with hundreds of millions of parameters. However, these models suffer from heavy model sizes and high latency such that they cannot be deployed to resource-limited mobile devices. In this paper, we propose MobileBERT for compressing and accelerating the popular BERT model. Like the original BERT, MobileBERT is task-agnostic, that is, it can be generically applied to various downstream NLP tasks via simple fine-tuning. Basically, MobileBERT is a thin version of BERT_LARGE, while equipped with bottleneck structures and a carefully designed balance between self-attentions and feed-forward networks. To train MobileBERT, we first train a specially designed teacher model, an inverted-bottleneck incorporated BERT_LARGE model. Then, we conduct knowledge transfer from this teacher to MobileBERT. Empirical studies show that MobileBERT is 4.3x smaller and 5.5x faster than BERT_BASE while achieving competitive results on well-known benchmarks. On the natural language inference tasks of GLUE, MobileBERT achieves a GLUEscore o 77.7 (0.6 lower than BERT_BASE), and 62 ms latency on a Pixel 4 phone. On the SQuAD v1.1/v2.0 question answering task, MobileBERT achieves a dev F1 score of 90.0/79.2 (1.5/2.1 higher than BERT_BASE).


title: Unexpected crystalline homogeneity from the disordered bond network in La(Cr0.2Mn0.2Fe0.2Co0.2Ni0.2)O3 films

abstract: Designing and understanding functional electronic and magnetic properties in perovskite oxides requires controlling and tuning the underlying crystal lattice. Here we report the structure, including oxygen and cation positions, of a single-crystal, entropy stabilized perovskite oxide film of La(Cr0.2Mn0.2Fe0.2Co0.2Ni0.2)O3 grown on SrTiO3 (001). The parent materials range from orthorhombic (LaCrO3, LaMnO3 and LaFeO3) to rhombohedral (LaCoO3 and LaNiO3), and first principles calculations indicate that these structural motifs are nearly degenerate in energy and should be highly distorted site-to-site. Despite this extraordinary local configurational disorder on the B-site sublattice, we find a structure with unexpected macroscopic crystalline homogeneity with a clear orthorhombic unit cell, whose orientation is demonstrated to be controlled by the strain and crystal structure of the substrate for films grown on (La0.3Sr0.7)(Al0.65Ta0.35)O3 (LSAT) and NdGaO3 (110). Furthermore, quantification of the atom positions within the unit cell reveal that the orthorhombic distortions are small, close to LaCrO3, which may be driven by a combination of disorder averaging and the average ionic radii. This is the first step towards understanding the rules for designing new crystal motifs and tuning functional properties through controlled configurational complexity.


title: Zero-Shot Learning of Text Adventure Games with Sentence-Level Semantics

abstract: Reinforcement learning algorithms such as Q-learning have shown great promise in training models to learn the optimal action to take for a given system state; a goal in applications with an exploratory or adversarial nature such as task-oriented dialogues or games. However, models that do not have direct access to their state are harder to train; when the only state access is via the medium of language, this can be particularly pronounced. We introduce a new model amenable to deep Q-learning that incorporates a Siamese neural network architecture and a novel refactoring of the Q-value function in order to better represent system state given its approximation over a language channel. We evaluate the model in the context of zero-shot text-based adventure game learning. Extrinsically, our model reaches the baseline's convergence performance point needing only 15% of its iterations, reaches a convergence performance point 15% higher than the baseline's, and is able to play unseen, unrelated games with no fine-tuning. We probe our new model's representation space to determine that intrinsically, this is due to the appropriate clustering of different linguistic mediation into the same state.


title: Violation of TUR in a periodically driven work-to-work converter from weak to strong dissipation

abstract: We study a model of isothermal steady-state work-to-work converter, where a single quantum two-level system (TLS) driven by time-dependent periodic external fields acts as the working medium and is permanently put in contact with a thermal reservoir at fixed temperature $T$. By combining Short-Iterative Lanczos (SIL) method and analytic approaches, we study the converter performance in the linear response regime and in a wide range of driving frequencies, from weak to strong dissipation. We show that for our ideal quantum machine several parameter ranges exist where a violation of Thermodynamics Uncertainty Relations (TUR) occurs. We find the violation to depend on the driving frequency and on the dissipation strength, and we trace it back to the degree of coherence of the quantum converter. We eventually discuss the influence of other possible sources of violation, such as non-Markovian effects during the converter dynamics.


title: Probabilistic Diagnostic Tests for Degradation Problems in Supervised Learning

abstract: Several studies point out different causes of performance degradation in supervised machine learning. Problems such as class imbalance, overlapping, small-disjuncts, noisy labels, and sparseness limit accuracy in classification algorithms. Even though a number of approaches either in the form of a methodology or an algorithm try to minimize performance degradation, they have been isolated efforts with limited scope. Most of these approaches focus on remediation of one among many problems, with experimental results coming from few datasets and classification algorithms, insufficient measures of prediction power, and lack of statistical validation for testing the real benefit of the proposed approach. This paper consists of two main parts: In the first part, a novel probabilistic diagnostic model based on identifying signs and symptoms of each problem is presented. Thereby, early and correct diagnosis of these problems is to be achieved in order to select not only the most convenient remediation treatment but also unbiased performance metrics. Secondly, the behavior and performance of several supervised algorithms are studied when training sets have such problems. Therefore, prediction of success for treatments can be estimated across classifiers.


title: Analyzing 3D Volume Segmentation by Low-level Perceptual Cues, High-level Cognitive Tasks, and Decision-making Processes

abstract: 3D volume segmentation is a fundamental task in many scientific and medical applications. Producing accurate segmentations efficiently is challenging, in part due to low imaging data quality (e.g., noise and low image resolution) and ambiguity in the data that can only be resolved with higher-level knowledge of the structure. Automatic algorithms do exist, but there are many use cases where they fail. The gold standard is still manual segmentation or review. Unfortunately, even for an expert, manual segmentation is laborious, time consuming, and prone to errors. Existing 3D segmentation tools are often designed based on the underlying algorithm, and do not take into account human mental models, their lower-level perception abilities, and higher-level cognitive tasks. Our goal is to analyze manual segmentation using the critical decision method (CDM) in order to gain a better understanding of the low-level (perceptual and marking) actions and higher-level decision-making processes that segmenters use. A key challenge we faced is that decision-making consists of an accumulated set of low-level visual-spatial decisions that are inter-related and difficult to articulate verbally. To address this, we developed a novel hybrid protocol which integrates CDM with eye-tracking, observation, and targeted questions. In this paper, we develop and validate data coding schemes for this hybrid data set that discern segmenters' low-level actions, higher-level cognitive tasks, overall task structures, and decision-making processes. We successfully detect the visual processing changes based on tasks sequences and micro decisions reflected in the eye-gaze data and identified different segmentation decision strategies utilized by the segmenters.


title: Evaluating the Evaluation of Diversity in Natural Language Generation

abstract: Despite growing interest in natural language generation (NLG) models that produce diverse outputs, there is currently no principled method for evaluating the diversity of an NLG system. In this work, we propose a framework for evaluating diversity metrics. The framework measures the correlation between a proposed diversity metric and a diversity parameter, a single parameter that controls some aspect of diversity in generated text. For example, a diversity parameter might be a binary variable used to instruct crowdsourcing workers to generate text with either low or high content diversity. We demonstrate the utility of our framework by: (a) establishing best practices for eliciting diversity judgments from humans, (b) showing that humans substantially outperform automatic metrics in estimating content diversity, and (c) demonstrating that existing methods for controlling diversity by tuning a "decoding parameter" mostly affect form but not meaning. Our framework can advance the understanding of different diversity metrics, an essential step on the road towards better NLG systems.


title: Formal vertex laws associated to Lie conformal algebras

abstract: We introduce several definitions within the framework of vertex and conformal algebras which are analogous to some important concepts of the classical Lie theory. Most importantly, we define formal vertex laws, which correspond to the notion of formal group law. We prove suitable vertex/conformal versions of a number of classical results such as the Milnor-Moore theorem, Cartier duality, and the equivalence between formal group laws and Lie algebras.


title: On exact laws of large numbers for Oppenheim expansions with infinite mean

abstract: In this work we investigate the asymptotic behaviour of weighted partial sums of a particular class of random variables related to Oppenheim series expansions. More precisely, we verify convergence in probability as well as almost sure convergence to a strictly positive and finite constant without assuming any dependence structure or the existence of means. Results of this kind are known as exact weak and exact strong laws.


title: Mechanochemical synthesis of Aromatic Infrared Band carriers. The top-down chemistry of interstellar carbonaceous dust grain analogues

abstract: Interstellar space hosts nanometre- to micron-sized dust grains. The carbonaceous-rich component of these grain populations emits in infrared bands, observed remotely for decades with telescopes and satellites. They are a key ingredient of astrochemical dust evolution. The precise carriers for most of these bands are still unknown and not well reproduced in the laboratory. In this work, we show the high-energy mechanochemical synthesis of disordered aromatic and aliphatic analogues provides interstellar relevant dust particles. The mechanochemical milling of carbon-based solids under a hydrogen atmosphere produces particles with a spectroscopic match to astrophysical observations of aromatic infrared band (AIB) emission. The H/C ratio for the analogues that best reproduce these astronomical infrared observations lies in the 5$\pm$2% range. This value is much lower than diffuse interstellar hydrogenated amorphous carbons, another Galactic dust grain component observed in absorption, and it most probably provides a constraint on the hydrogenation degree of the most aromatic carbonaceous dust grain carriers. A broad band, observed in AIBs, in the 7.4-8.3 $\mu$m range is correlated to the hydrogen content, and thus the structural evolution in the analogues produced. The mechanochemical process can be seen as an experimental reactor to stimulate local energetic chemical reactions. It introduces bond disorder and hydrogen chemical attachment on the produced defects, with an effect similar to the interstellar space very localised chemical reactions with solids. From the vantage point of astrophysics, these laboratory interstellar dust analogues will be used to predict dust grain evolution under simulated interstellar conditions, including harsh radiative environments. Such interstellar analogues offer an opportunity to derive a global view on the cycling of matter in other star forming systems.


title: On the Theory of Covariate-Adaptive Designs

abstract: Pocock and Simon's marginal procedure (Pocock and Simon, 1975) is often implemented forbalancing treatment allocation over influential covariates in clinical trials. However, the theoretical properties of Pocock and Simion's procedure have remained largely elusive for decades. In this paper, we propose a general framework for covariate-adaptive designs and establish the corresponding theory under widely satisfied conditions. As a special case, we obtain the theoretical properties of Pocock and Simon's marginal procedure: the marginal imbalances and overall imbalance are bounded in probability, but the within-stratum imbalances increase with the rate of $\sqrt{n}$ as the sample size increases. The theoretical results provide new insights about balance properties of covariate-adaptive randomization procedures and open a door to study the theoretical properties of statistical inference for clinical trials based on covariate-adaptive randomization procedures.


title: Multi-Step Inference for Reasoning Over Paragraphs

abstract: Complex reasoning over text requires understanding and chaining together free-form predicates and logical connectives. Prior work has largely tried to do this either symbolically or with black-box transformers. We present a middle ground between these two extremes: a compositional model reminiscent of neural module networks that can perform chained logical reasoning. This model first finds relevant sentences in the context and then chains them together using neural modules. Our model gives significant performance improvements (up to 29\% relative error reduction when comfibined with a reranker) on ROPES, a recently introduced complex reasoning dataset.


title: Variable Autonomy of Whole-body Control for Inspection and Intervention in Industrial Environments using Legged Robots

abstract: The deployment of robots in industrial and civil scenarios is a viable solution to protect operators from danger and hazards. Shared autonomy is paramount to enable remote control of complex systems such as legged robots, allowing the operator to focus on the essential tasks instead of overly detailed execution. To realize this, we propose a comprehensive control framework for inspection and intervention using a legged robot and validate the integration of multiple loco-manipulation algorithms optimised for improving the remote operation. The proposed control offers 3 operation modes: fully automated, semi-autonomous, and the haptic interface receiving onsite physical interaction for assisting teleoperation. Our contribution is the design of a QP-based semi-analytical whole-body control, which is the key to the various task completion subject to internal and external constraints. We demonstrate the versatility of the whole-body control in terms of decoupling tasks, singularity tolerance and constraint satisfaction. We deploy our solution in field trials and evaluate in an emergency setting by an E-stop while the robot is clearing road barriers and traversing difficult terrains.


title: Hardware Trojan Detection Using Controlled Circuit Aging

abstract: This paper reports a novel approach that uses transistor aging in an integrated circuit (IC) to detect hardware Trojans. When a transistor is aged, it results in delays along several paths of the IC. This increase in delay results in timing violations that reveal as timing errors at the output of the IC during its operation. We present experiments using aging-aware standard cell libraries to illustrate the usefulness of the technique in detecting hardware Trojans. Combining IC aging with over-clocking produces a pattern of bit errors at the IC output by the induced timing violations. We use machine learning to learn the bit error distribution at the output of a clean IC. We differentiate the divergence in the pattern of bit errors because of a Trojan in the IC from this baseline distribution. We simulate the golden IC and show robustness to IC-to-IC manufacturing variations. The approach is effective and can detect a Trojan even if we place it far off the critical paths. Results on benchmarks from the Trust-hub show a detection accuracy of $\geq$99%.


title: Protocols for long-distance quantum communication with single $^{167}$Er ions

abstract: We design a quantum repeater architecture using individual $^{167}$Er ions doped into Y$_2$SiO$_5$ crystal. This ion is a promising candidate for a repeater protocol because of its long hyperfine coherence time in addition to its ability to emit photons within the telecommunication wavelength range. To distribute entanglement over a long distance, we propose two different swapping gates between nearby ions using the exchange of virtual cavity photons and the electric dipole-dipole interaction. We analyze their expected performance, and discuss their strengths and weaknesses. Then, we show that a post-selection approach can be implemented to improve the gate fidelity of the virtual photon exchange scheme by monitoring cavity emission. Finally, we use our results for the swapping gates to estimate the end-to-end fidelity and distribution rate for the protocol.


title: Unexpected two-fold symmetric superconductivity in few-layer NbSe$_2$

abstract: Two-dimensional transition metal dichalcogenides (TMDs) have been attracting significant interest due to a range of properties, such as layer-dependent inversion symmetry, valley-contrasted Berry curvatures, and strong spin-orbit coupling (SOC). Of particular interest is niobium diselenide (NbSe2), whose superconducting state in few-layer samples is profoundly affected by an unusual type of SOC called Ising SOC. Combined with the reduced dimensionality, the latter stabilizes the superconducting state against magnetic fields up to ~35 T and could lead to other exotic properties such as nodal and crystalline topological superconductivity. Here, we report transport measurements of few-layer NbSe$_2$ under in-plane external magnetic fields, revealing an unexpected two-fold rotational symmetry of the superconducting state. In contrast to the three-fold symmetry of the lattice, we observe that the magnetoresistance and critical field exhibit a two-fold oscillation with respect to an applied in-plane magnetic field. We find similar two-fold oscillations deep inside the superconducting state in differential conductance measurements on NbSe$_2$/CrBr$_3$ superconductor-magnet junctions. In both cases, the anisotropy vanishes in the normal state, demonstrating that it is an intrinsic property of the superconducting phase. We attribute the behavior to the mixing between two closely competing pairing instabilities, namely, the conventional s-wave instability typical of bulk NbSe$_2$ and an unconventional d- or p-wave channel that emerges in few-layer NbSe2. Our results thus demonstrate the unconventional character of the pairing interaction in a few-layer TMD, opening a new avenue to search for exotic superconductivity in this family of 2D materials.


title: Modal Expansion of the Impulse Response Function for Predicting the Time Dynamics of Open Optical Cavities

abstract: Light interaction with optical cavities is of fundamental interest to enhance the light-matter interaction and to shape the spectral features of the electromagnetic fields. Important efforts have been carried out to develop modal theories of open optical cavities relying on an expansion of the fields on the eigen-fields of the cavity. Here, we show how such an expansion predicts the temporal dynamics of optical resonators. We consider a Fabry-Perot cavity to derive the full analytical expressions of the internal and scattered field on the quasi-normal modes basis together with the complex eigen-frequencies. We evince the convergence and accuracy of this expansion before deriving the impulse response function (IRF) of the open cavity. We benefit from this modal expansion and IRF to demonstrate that the eigen-modes of the open cavity impact the signals only during the transient regimes and not in the permanent regime.


title: Plaquette versus ordinary $d$-wave pairing in the $t'$-Hubbard model on a width 4 cylinder

abstract: The Hubbard model and its extensions are important microscopic models for understanding high- $T_c$ superconductivity in cuprates. In the model with next-nearest-neighbor hopping $t'$ (the $t'$- Hubbard model), pairing is strongly influenced by $t'$ . In particular, a recent study on a width-4 cylinder observed quasi-long-rage superconducting order, associated with a negative $t'$ , which was taken to imply superconductivity in the two-dimensional (2D) limit. In this work we study more carefully pairing in the width-4 $t'$-Hubbard model. We show that in this specific system, the pairing symmetry with $t'<0$ is not the ordinary $d$-wave one would expect in the 2D limit. Instead we observe a so-called plaquette d-wave pairing. The plaquette d-wave exists only on a width-4 cylinder, and so is not representative of the 2D limit. We find that a negative $t'$ suppresses the conventional d-wave, leading to plaquette pairing. In contrast, a different $t''$ coupling acting diagonally on the plaquettes suppresses plaquette pairing, leading to conventional $d$-wave pairing.


title: Can Two Walk Together: Privacy Enhancing Methods and Preventing Tracking of Users

abstract: We present a new concern when collecting data from individuals that arises from the attempt to mitigate privacy leakage in multiple reporting: tracking of users participating in the data collection via the mechanisms added to provide privacy. We present several definitions for untrackable mechanisms, inspired by the differential privacy framework. Specifically, we define the trackable parameter as the log of the maximum ratio between the probability that a set of reports originated from a single user and the probability that the same set of reports originated from two users (with the same private value). We explore the implications of this new definition. We show how differentially private and untrackable mechanisms can be combined to achieve a bound for the problem of detecting when a certain user changed their private value. Examining Google's deployed solution for everlasting privacy, we show that RAPPOR (Erlingsson et al. ACM CCS, 2014) is trackable in our framework for the parameters presented in their paper. We analyze a variant of randomized response for collecting statistics of single bits, Bitwise Everlasting Privacy, that achieves good accuracy and everlasting privacy, while only being reasonably untrackable, specifically grows linearly in the number of reports. For collecting statistics about data from larger domains (for histograms and heavy hitters) we present a mechanism that prevents tracking for a limited number of responses. We also present the concept of Mechanism Chaining, using the output of one mechanism as the input of another, in the scope of Differential Privacy, and show that the chaining of an $\varepsilon_1$-LDP mechanism with an $\varepsilon_2$-LDP mechanism is $\ln\frac{e^{\varepsilon_1+\varepsilon_2}+1}{e^{\varepsilon_1}+e^{\varepsilon_2}}$-LDP and that this bound is tight.


title: Customized data-driven RANS closures for bi-fidelity LES-RANS optimization

abstract: Multi-fidelity optimization methods promise a high-fidelity optimum at a cost only slightly greater than a low-fidelity optimization. This promise is seldom achieved in practice, due to the requirement that low- and high-fidelity models correlate well. In this article, we propose an efficient bi-fidelity shape optimization method for turbulent fluid-flow applications with Large-Eddy Simulation (LES) and Reynolds-averaged Navier-Stokes (RANS) as the high- and low-fidelity models within a hierarchical-Kriging surrogate modelling framework. Since the LES-RANS correlation is often poor, we use the full LES flow-field at a single point in the design space to derive a custom-tailored RANS closure model that reproduces the LES at that point. This is achieved with machine-learning techniques, specifically sparse regression to obtain high corrections of the turbulence anisotropy tensor and the production of turbulence kinetic energy as functions of the RANS mean-flow. The LES-RANS correlation is dramatically improved throughout the design-space. We demonstrate the effectiveness and efficiency of our method in a proof-of-concept shape optimization of the well-known periodic-hill case. Standard RANS models perform poorly in this case, whereas our method converges to the LES-optimum with only two LES samples.


title: Classical Optimizers for Noisy Intermediate-Scale Quantum Devices

abstract: We present a collection of optimizers tuned for usage on Noisy Intermediate-Scale Quantum (NISQ) devices. Optimizers have a range of applications in quantum computing, including the Variational Quantum Eigensolver (VQE) and Quantum Approximate Optimization (QAOA) algorithms. They are also used for calibration tasks, hyperparameter tuning, in machine learning, etc. We analyze the efficiency and effectiveness of different optimizers in a VQE case study. VQE is a hybrid algorithm, with a classical minimizer step driving the next evaluation on the quantum processor. While most results to date concentrated on tuning the quantum VQE circuit, we show that, in the presence of quantum noise, the classical minimizer step needs to be carefully chosen to obtain correct results. We explore state-of-the-art gradient-free optimizers capable of handling noisy, black-box, cost functions and stress-test them using a quantum circuit simulation environment with noise injection capabilities on individual gates. Our results indicate that specifically tuned optimizers are crucial to obtaining valid science results on NISQ hardware, and will likely remain necessary even for future fault tolerant circuits.


title: Convergence and Complexity Analysis of a Levenberg-Marquardt Algorithm for Inverse Problems

abstract: The Levenberg-Marquardt algorithm is one of the most popular algorithms for finding the solution of nonlinear least squares problems. Across different modified variations of the basic procedure, the algorithm enjoys global convergence, a competitive worst case iteration complexity rate, and a guaranteed rate of local convergence for both zero and nonzero small residual problems, under suitable assumptions. We introduce a novel Levenberg-Marquardt method that matches, simultaneously, the state of the art in all of these convergence properties with a single seamless algorithm. Numerical experiments confirm the theoretical behavior of our proposed algorithm.


title: Large Deviations in the Supremum Norm for a Reaction-Diffusion System

abstract: We present large deviations estimates in the supremum norm for a system of independent random walks superposed with a birth-and-death dynamics evolving on the discrete torus with $N$ sites. The scaling limit considered is the so-called \textit{high density limit} (see the survey \cite{franco} on the subject), where space, time and initial quantity of particles are rescaled. The associated rate functional here obtained is a semi-linearised version of the rate function of \cite{JonaLandimVares}, which dealt with large deviations of exclusion processes superposed with birth-and-death dynamics. An ingredient in the proof of large deviations consists in providing a limit of a suitable class of perturbations of the original process. This is precisely one of the main contributions of this work: a strategy to extend the original high density approach (as in \cite{Arnold,blount2,blount,francogroisman,Kote2,KoteHigh1988}) to weakly asymmetric systems. Two cases are considered with respect to the initial quantity of particles, the power law and the (at least) exponential growth. In the first case, we present the lower bound only on a certain subset of smooth profiles, while in the second case, additionally assuming concavity of the birth and the death functions and a constant initial profile, we provide a full large deviations principle.


title: Atmospheric convection plays a key role in the climate of tidally-locked terrestrial exoplanets: insights from high-resolution simulations

abstract: Using a 3D general circulation model (GCM), we investigate the sensitivity of the climate of tidally-locked Earth-like exoplanets, Trappist-1e and Proxima Centauri b, to the choice of a convection parameterization. Compared to a mass-flux convection parameterization, a simplified convection adjustment parameterization leads to a $>$60% decrease of the cloud albedo, increasing the mean day-side temperature by $\approx$10 K. The representation of convection also affects the atmospheric conditions of the night side, via a change in planetary-scale wave patterns. As a result, using the convection adjustment scheme makes the night-side cold traps warmer by 17-36 K for the planets in our simulations. The day-night thermal contrast is sensitive to the representation of convection in 3D GCM simulations, so caution should be taken when interpreting emission phase curves. The choice of convection treatment, however, does not alter the simulated climate enough to result in a departure from habitable conditions, at least for the atmospheric composition and planetary parameters used in our study. The near-surface conditions both in the Trappist-1e and Proxima b cases remain temperate, allowing for an active water cycle. We further advance our analysis using high-resolution model experiments, in which atmospheric convection is simulated explicitly. Our results suggest that in a hypothetical global convection-permitting simulation the surface temperature contrast would be higher than in the coarse-resolution simulations with parameterized convection. In other words, models with parameterized convection may overestimate the inter-hemispheric heat redistribution efficiency.


title: A Spatial Time-Frequency Hopping Index Modulated Scheme in Turbulence-free Optical Wireless Communication Channels

abstract: In this article, we propose an index modulation system suitable for optical communications, where the intensity of the light is modulated along the time, space and frequency dimensions, building a Frequency-Hopping Spatial Multi-Pulse Position Modulation (FH-SMPPM). We analyze its performance from the point of view of its efficiency in power and spectrum, and its implementation complexity and required receiver latency. We analyze its error probability in the case of the non-turbulent free-space optical (FSO) channel. We derive formulas for the average symbol and bit error probabilities, and the simulation results show that they are tight enough for a wide range of signal-to-noise ratios and system parameters. We compare FH-SMPPM with other proposed index modulated systems of the same nature, and we highlight its distinctive advantages, like the flexibility to build an appropriate waveform under different constraints and objectives. Moreover, FH-SMPPM shows to be better performing in BER/SER and/or offer advantages in efficiency with respect to those alternatives, thus offering the possibility to be adopted for a variety of contexts.


title: Parker Solar Probe observations of proton beams simultaneous with ion-scale waves

abstract: Parker Solar Probe (PSP), NASA's latest and closest mission to the Sun, is on a journey to investigate fundamental enigmas of the inner heliosphere. This paper reports initial observations made by the Solar Probe Analyzer for Ions (SPAN-I), one of the instruments in the Solar Wind Electrons Alphas and Protons (SWEAP) instrument suite. We address the presence of secondary proton beams in concert with ion-scale waves observed by FIELDS, the electromagnetic fields instrument suite. We show two events from PSP's 2nd orbit that demonstrate signatures consistent with wave-particle interactions. We showcase 3D velocity distribution functions (VDFs) measured by SPAN-I during times of strong wave power at ion-scales. From an initial instability analysis, we infer that the VDFs departed far enough away from local thermodynamic equilibrium (LTE) to provide sufficient free energy to locally generate waves. These events exemplify the types of instabilities that may be present and, as such, may guide future data analysis characterizing and distinguishing between different wave-particle interactions.


title: The multi-objective optimisation of breakwaters using evolutionary approach

abstract: In engineering practice, it is often necessary to increase the effectiveness of existing protective constructions for ports and coasts (i. e. breakwaters) by extending their configuration, because existing configurations don't provide the appropriate environmental conditions. That extension task can be considered as an optimisation problem. In the paper, the multi-objective evolutionary approach for the breakwaters optimisation is proposed. Also, a greedy heuristic is implemented and included to algorithm, that allows achieving the appropriate solution faster. The task of the identification of the attached breakwaters optimal variant that provides the safe ship parking and manoeuvring in large Black Sea Port of Sochi has been used as a case study. The results of the experiments demonstrated the possibility to apply the proposed multi-objective evolutionary approach in real-world engineering problems. It allows identifying the Pareto-optimal set of the possible configuration, which can be analysed by decision makers and used for final construction


title: On the Persistence of Persistent Identifiers of the Scholarly Web

abstract: Scholarly resources, just like any other resources on the web, are subject to reference rot as they frequently disappear or significantly change over time. Digital Object Identifiers (DOIs) are commonplace to persistently identify scholarly resources and have become the de facto standard for citing them. We investigate the notion of persistence of DOIs by analyzing their resolution on the web. We derive confidence in the persistence of these identifiers in part from the assumption that dereferencing a DOI will consistently return the same response, regardless of which HTTP request method we use or from which network environment we send the requests. Our experiments show, however, that persistence, according to our interpretation, is not warranted. We find that scholarly content providers respond differently to varying request methods and network environments and even change their response to requests against the same DOI. In this paper we present the results of our quantitative analysis that is aimed at informing the scholarly communication community about this disconcerting lack of consistency.


title: "You are grounded!": Latent Name Artifacts in Pre-trained Language Models

abstract: Pre-trained language models (LMs) may perpetuate biases originating in their training corpus to downstream models. We focus on artifacts associated with the representation of given names (e.g., Donald), which, depending on the corpus, may be associated with specific entities, as indicated by next token prediction (e.g., Trump). While helpful in some contexts, grounding happens also in under-specified or inappropriate contexts. For example, endings generated for `Donald is a' substantially differ from those of other names, and often have more-than-average negative sentiment. We demonstrate the potential effect on downstream tasks with reading comprehension probes where name perturbation changes the model answers. As a silver lining, our experiments suggest that additional pre-training on different corpora may mitigate this bias.


title: The radius of comparison of the tensor product of a C*-algebra with $C (X)$

abstract: Let $X$ be a compact metric space, let $A$ be a unital AH algebra with large matrix sizes, and let $B$ be a stably finite unital C*-algebra. Then we give a lower bound for the radius of comparison of $C(X) \otimes B$ and prove that the dimension-rank ratio satisfies $\operatorname{drr} (A) = \operatorname{drr} \left(C(X)\otimes A\right)$. We also give a class of unital AH algebras $A$ with $\operatorname{rc} \left(C(X) \otimes A\right) = \operatorname{rc} (A)$. We further give a class of stably finite exact $\mathcal{Z}$-stable unital C*-algebras with nonzero radius of comparison.


title: Coleman-Weinberg potential in $p$-adic field theory

abstract: In this paper, we study $\lambda \phi^4$ scalar field theory defined on the unramified extension of p-adic numbers ${\mathbb Q}_{p^n}$. For different ``space-time'' dimensions $n$, we compute one-loop quantum corrections to the effective potential. Surprisingly, despite the unusual properties of non-Archimedean geometry, the Coleman-Weinberg potential of p-adic field theory has a structure very similar to that of its real cousin. We also study two formal limits of the effective potential, $p \rightarrow 1$ and $p \rightarrow \infty$. We show that the $p\rightarrow 1$ limit allows to reconstruct the canonical result for real field theory from the p-adic effective potential and provide an explanation of this fact. On the other hand, in the $p\rightarrow\infty$ limit, the theory exhibits very peculiar behavior with emerging logarithmic terms in the effective potential, which has no analog in real theories.


title: Adaptive Fractional Dilated Convolution Network for Image Aesthetics Assessment

abstract: To leverage deep learning for image aesthetics assessment, one critical but unsolved issue is how to seamlessly incorporate the information of image aspect ratios to learn more robust models. In this paper, an adaptive fractional dilated convolution (AFDC), which is aspect-ratio-embedded, composition-preserving and parameter-free, is developed to tackle this issue natively in convolutional kernel level. Specifically, the fractional dilated kernel is adaptively constructed according to the image aspect ratios, where the interpolation of nearest two integers dilated kernels is used to cope with the misalignment of fractional sampling. Moreover, we provide a concise formulation for mini-batch training and utilize a grouping strategy to reduce computational overhead. As a result, it can be easily implemented by common deep learning libraries and plugged into popular CNN architectures in a computation-efficient manner. Our experimental results demonstrate that our proposed method achieves state-of-the-art performance on image aesthetics assessment over the AVA dataset.


title: Graph Distances and Clustering

abstract: With a view on graph clustering, we present a definition of vertex-to-vertex distance which is based on shared connectivity. We argue that vertices sharing more connections are closer to each other than vertices sharing fewer connections. Our thesis is centered on the widely accepted notion that strong clusters are formed by high levels of induced subgraph density, where subgraphs represent clusters. We argue these clusters are formed by grouping vertices deemed to be similar in their connectivity. At the cluster level (induced subgraph level), our thesis translates into low mean intra-cluster distances. Our definition differs from the usual shortest-path geodesic distance. In this article, we compare three distance measures from the literature. Our benchmark is the accuracy of each measure's reflection of intra-cluster density, when aggregated (averaged) at the cluster level. We conduct our tests on synthetic graphs generated using the planted partition model, where clusters and intra-cluster density are known in advance. We examine correlations between mean intra-cluster distances and intra-cluster densities. Our numerical experiments show that Jaccard and Otsuka-Ochiai offer very accurate measures of density, when averaged over vertex pairs within clusters.


title: Hybrid real- and reciprocal-space full-field imaging with coherent illumination

abstract: We present a novel diffractive imaging method that harnesses a low-resolution real-space image to guide the phase retrieval. A computational algorithm is developed to utilize such prior knowledge as a real-space constraint in the iterative phase retrieval procedure. Numerical simulations and proof-of-concept experiments are carried out, demonstrating our method's capability of reconstructing high-resolution details that are otherwise inaccessible with traditional phasing algorithms. With the present method, we formulate a conceptual design for the coherent imaging experiments at a next-generation X-ray light source.


title: Graphene disk in a solenoid magnetic potential: Aharonov-Bohm effect without a two-slit-like setup

abstract: The Aharonov-Bohm effect allows one to demonstrate the physical meaningfulness of magnetic vector potential by passing the current in zero magnetic field regions. In the standard (a {\em two-slit-like}) setup a conducting ring is pierced by magnetic flux and the quantum interference for an electron passing simultaneously the two ring arms is observed. Here we show, by analyzing the transport via evanescent waves, that the ballistic Corbino disk in graphene subjected to a solenoid magnetic potential may exhibit the conductance oscillations of the Aharonov-Bohm kind although the current flows through a single conducting element only.


title: Disentangled Sticky Hierarchical Dirichlet Process Hidden Markov Model

abstract: The Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) has been used widely as a natural Bayesian nonparametric extension of the classical Hidden Markov Model for learning from sequential and time-series data. A sticky extension of the HDP-HMM has been proposed to strengthen the self-persistence probability in the HDP-HMM. However, the sticky HDP-HMM entangles the strength of the self-persistence prior and transition prior together, limiting its expressiveness. Here, we propose a more general model: the disentangled sticky HDP-HMM (DS-HDP-HMM). We develop novel Gibbs sampling algorithms for efficient inference in this model. We show that the disentangled sticky HDP-HMM outperforms the sticky HDP-HMM and HDP-HMM on both synthetic and real data, and apply the new approach to analyze neural data and segment behavioral video data.


title: Enhancing Review Comprehension with Domain-Specific Commonsense

abstract: Review comprehension has played an increasingly important role in improving the quality of online services and products and commonsense knowledge can further enhance review comprehension. However, existing general-purpose commonsense knowledge bases lack sufficient coverage and precision to meaningfully improve the comprehension of domain-specific reviews. In this paper, we introduce xSense, an effective system for review comprehension using domain-specific commonsense knowledge bases (xSense KBs). We show that xSense KBs can be constructed inexpensively and present a knowledge distillation method that enables us to use xSense KBs along with BERT to boost the performance of various review comprehension tasks. We evaluate xSense over three review comprehension tasks: aspect extraction, aspect sentiment classification, and question answering. We find that xSense outperforms the state-of-the-art models for the first two tasks and improves the baseline BERT QA model significantly, demonstrating the usefulness of incorporating commonsense into review comprehension pipelines. To facilitate future research and applications, we publicly release three domain-specific knowledge bases and a domain-specific question answering benchmark along with this paper.


title: LogicNets: Co-Designed Neural Networks and Circuits for Extreme-Throughput Applications

abstract: Deployment of deep neural networks for applications that require very high throughput or extremely low latency is a severe computational challenge, further exacerbated by inefficiencies in mapping the computation to hardware. We present a novel method for designing neural network topologies that directly map to a highly efficient FPGA implementation. By exploiting the equivalence of artificial neurons with quantized inputs/outputs and truth tables, we can train quantized neural networks that can be directly converted to a netlist of truth tables, and subsequently deployed as a highly pipelinable, massively parallel FPGA circuit. However, the neural network topology requires careful consideration since the hardware cost of truth tables grows exponentially with neuron fan-in. To obtain smaller networks where the whole netlist can be placed-and-routed onto a single FPGA, we derive a fan-in driven hardware cost model to guide topology design, and combine high sparsity with low-bit activation quantization to limit the neuron fan-in. We evaluate our approach on two tasks with very high intrinsic throughput requirements in high-energy physics and network intrusion detection. We show that the combination of sparsity and low-bit activation quantization results in high-speed circuits with small logic depth and low LUT cost, demonstrating competitive accuracy with less than 15 ns of inference latency and throughput in the hundreds of millions of inferences per second.


title: The 2019 super-Eddington outburst of RX J0209.6-7427: Detection of pulsations and constraints on the magnetic field strength

abstract: In November 2019, MAXI detected an X-ray outburst from the known Be X-ray binary system RX J0209.6-7427 located in the outer wing of the Small Magellanic Cloud. We followed the outburst of the system with NICER which led to the discovery of X-ray pulsations with a period of 9.3 s. We analyzed simultaneous X-ray data obtained with NuSTAR and NICER allowing us to characterize the spectrum and provide an accurate estimate of its bolometric luminosity. During the outburst the maximum broadband X-ray luminosity of the system reached $1-2\times10^{39}$ erg/s, thus exceeding by about one order of magnitude the Eddington limit for a typical 1.4 $M_{\odot}$ mass neutron star (NS). Monitoring observations with Fermi/GBM and NICER allowed us to study the spin evolution of the NS and compare it with standard accretion torque models. We found that the NS magnetic field should be of the order of $3\times10^{12}$ G. We conclude that RX J0209.6-7427 exhibited one of the brightest outbursts observed from a Be X-ray binary pulsar in the Magellanic Clouds, reaching similar luminosity level to the 2016 outburst of SMC X-3. Despite the super-Eddington luminosity of RX J0209.6-7427, the NS appears to have only a moderate magnetic field strength.


title: Field-Level Crop Type Classification with k Nearest Neighbors: A Baseline for a New Kenya Smallholder Dataset

abstract: Accurate crop type maps provide critical information for ensuring food security, yet there has been limited research on crop type classification for smallholder agriculture, particularly in sub-Saharan Africa where risk of food insecurity is highest. Publicly-available ground-truth data such as the newly-released training dataset of crop types in Kenya (Radiant MLHub) are catalyzing this research, but it is important to understand the context of when, where, and how these datasets were obtained when evaluating classification performance and using them as a benchmark across methods. In this paper, we provide context for the new western Kenya dataset which was collected during an atypical 2019 main growing season and demonstrate classification accuracy up to 64% for maize and 70% for cassava using k Nearest Neighbors--a fast, interpretable, and scalable method that can serve as a baseline for future work.


title: Characters, Coadjoint Orbits and Duistermaat-Heckman Integrals

abstract: The asymptotics of characters $\chi_{k\lambda}(\exp(h/k))$ of irreducible representations of a compact Lie group $G$ for large values of the scaling factor $k$ are given by Duistermaat-Heckman (DH) integrals over coadjoint orbits of $G$. This phenomenon generalises to coadjoint orbits of central extensions of loop groups $\widehat{LG}$ and of diffeomorphisms of the circle $\widehat{\rm Diff}(S^1)$. We show that the asymptotics of characters of integrable modules of affine Kac-Moody algebras and of the Virasoro algebra factorize into a divergent contribution of the standard form and a convergent contribution which can be interpreted as a formal DH orbital integral. For some Virasoro modules, our results match the formal DH integrals recently computed by Stanford and Witten. In this case, the $k$-scaling has the same origin as the one which gives rise to classical conformal blocks. Furthermore, we consider reduced spaces of Virasoro coadjoint orbits and we suggest a new invariant which replaces symplectic volume in the infinite dimensional situation. We also consider other modules of the Virasoro algebra (in particular, the modules corresponding to minimal models) and we obtain DH-type expressions which do not correspond to any Virasoro coadjoint orbits. We study volume functions $V(x)$ corresponding to formal DH integrals over coadjoint orbits of the Virasoro algebra. We show that they are related by the Hankel transform to spectral densities $\rho(E)$ recently studied by Saad, Shenker and Stanford.


title: Efficient Computational Design of 2D van der Waals Heterostructures: Band-Alignment, Lattice-Mismatch, Web-app Generation and Machine-learning

abstract: We develop a computational database, web-apps, and machine-learning (ML) models to accelerate the design and discovery of two-dimensional (2D)-heterostructures. Using density functional theory (DFT) based lattice-parameters and electronic band-energies for 674 non-metallic exfoliable 2D-materials, we generate 226,779 possible heterostructures. We classify these heterostructures into type-I, II and III systems according to Andersons rule, which is based on the relative band-alignments of the non-interacting monolayers. We find that type-II is the most common and the type-III the least common heterostructure type. We subsequently analyze the chemical trends for each heterostructure type in terms of the periodic table of constituent elements. The band alignment data can be also used for identifying photocatalysts and high-work function 2D-metals for contacts. We validate our results by comparing them to experimental data as well as hybrid-functional predictions. Additionally, we carry out DFT calculations of a few selected systems (MoS2/WSe2, MoS2/h-BN, MoSe2/CrI3), to compare the band-alignment description with the predictions from Andersons rule. We develop web-apps to enable users to virtually create combinations of 2D materials and predict their properties. Additionally, we use ML tools to predict band-alignment information for 2D materials. The web-apps, tools and associated data will be distributed through JARVIS-Heterostructure website (https://jarvis.nist.gov/jarvish/). Our analysis, results and the developed web-apps can be applied to the screening and design applications, such as finding novel photocatalysts, photodetectors, and high-work function (WF) 2D-metal contacts.


title: Unit Groups of Some Group Rings

abstract: Let $RG$ be the gruop ring of the group $G$ over ring $R$ and $\mathscr{U}(RG)$ be its unit group. Finding the structure of the unit group of a finite group ring is an old topic in ring theory. In, G. Tang et al: Unit Groups of Group Algebras of Some Small Groups. Czech. Math. J. 64 (2014), 149--157, the structure of the unit group of the group ring of the non abelian group $G$ with order $21$ over any finite field of characteristic 3 was established. In this paper, we are going to generalize their result to any non abelian group $G=T_{3m}$, where $T_{3m} = \langle x,y\,|\,x^m=y^3=1,\,x^y=x^t\rangle$.


title: Query Focused Multi-Document Summarization with Distant Supervision

abstract: We consider the problem of better modeling query-cluster interactions to facilitate query focused multi-document summarization (QFS). Due to the lack of training data, existing work relies heavily on retrieval-style methods for estimating the relevance between queries and text segments. In this work, we leverage distant supervision from question answering where various resources are available to more explicitly capture the relationship between queries and documents. We propose a coarse-to-fine modeling framework which introduces separate modules for estimating whether segments are relevant to the query, likely to contain an answer, and central. Under this framework, a trained evidence estimator further discerns which retrieved segments might answer the query for final selection in the summary. We demonstrate that our framework outperforms strong comparison systems on standard QFS benchmarks.


title: Learning Generative Models of Shape Handles

abstract: We present a generative model to synthesize 3D shapes as sets of handles -- lightweight proxies that approximate the original 3D shape -- for applications in interactive editing, shape parsing, and building compact 3D representations. Our model can generate handle sets with varying cardinality and different types of handles (Figure 1). Key to our approach is a deep architecture that predicts both the parameters and existence of shape handles, and a novel similarity measure that can easily accommodate different types of handles, such as cuboids or sphere-meshes. We leverage the recent advances in semantic 3D annotation as well as automatic shape summarizing techniques to supervise our approach. We show that the resulting shape representations are intuitive and achieve superior quality than previous state-of-the-art. Finally, we demonstrate how our method can be used in applications such as interactive shape editing, completion, and interpolation, leveraging the latent space learned by our model to guide these tasks. Project page: http://mgadelha.me/shapehandles.


title: A BDF2-Semismooth Newton Algorithm for the Numerical Solution of the Bingham Flow with Temperature Dependent Parameters

abstract: This paper is devoted to the numerical solution of the non-isothermal instationary Bingham flow with temperature dependent parameters by semismooth Newton methods. We discuss the main theoretical aspects regarding this problem. Mainly, we focus on existence of solutions and a multiplier formulation which leads us to a coupled system of PDEs involving a Navier-Stokes type equation and a parabolic energy PDE. Further, we propose a Huber regularization for this coupled system of partial differential equations, and we briefly discuss the well posedness of these regularized problems. A detailed finite element discretization, based on the so called (cross-grid $\mathbb{P}_1$) - $\mathbb{Q}_0$ elements, is proposed for the space variable, involving weighted stiffness and mass matrices. After discretization in space, a second order BDF method is used as a time advancing technique, leading, in each time iteration, to a nonsmooth system of equations, which is suitable to be solved by a semismooth Newton algorithm. Therefore, we propose and discuss the main properties of a SSN algorithm, including the convergence properties. The paper finishes with two computational experiment that exhibit the main properties of the numerical approach.


title: A set-theoretic generalization of dissipativity with applications in Tube MPC

abstract: This paper introduces a framework for analyzing a general class of uncertain nonlinear discrete-time systems with given state-, control-, and disturbance constraints. In particular, we propose a set-theoretic generalization of the concept of dissipativity of systems that are affected by external disturbances. The corresponding theoretical developments build upon set based analysis methods and lay a general theoretical foundation for a rigorous stability analysis of economic tube model predictive controllers. Besides, we discuss practical prodecures for verifying set-dissipativity of constrained linear control systems with convex stage costs.


title: Turbulence closure modeling with data-driven techniques: physical compatibility and consistency considerations

abstract: A recent thrust in turbulence closure modeling research is to incorporate machine learning (ML) elements, such as neural networks, for the purpose of enhancing the predictive capability to a broader class of flows. Such a turbulence closure framework entails solving a system of equations comprised of ML functionals coupled with traditional (physics-based - PB) elements. While combining closure elements from fundamentally different ideologies can lead to unprecedented progress, there are many critical challenges that must be overcome. This study examines three such challenges: (i) Physical compatibility (or lack thereof) between ML and PB constituents of the modeling system of equations; (ii) Internal (self) consistency of the ML training process; and (iii) Formulation of an optimal objective (or loss) function for training. These issues are critically important for generalization of the ML-enhanced methods to predictive computations of complex engineering flows. Training and implementation strategies in current practice that may lead to significant incompatibilities and inconsistencies are identified. Using the simple test case of turbulent channel flow, key deficiencies are highlighted and proposals for mitigating them are investigated. Compatibility constraints are evaluated and it is demonstrated that an iterative training procedure can help ensure certain degree of consistency. In summary, this work develops foundational tenets to guide development of ML-enhanced turbulence closure models.


title: A Systematic Analysis of Morphological Content in BERT Models for Multiple Languages

abstract: This work describes experiments which probe the hidden representations of several BERT-style models for morphological content. The goal is to examine the extent to which discrete linguistic structure, in the form of morphological features and feature values, presents itself in the vector representations and attention distributions of pre-trained language models for five European languages. The experiments contained herein show that (i) Transformer architectures largely partition their embedding space into convex sub-regions highly correlated with morphological feature value, (ii) the contextualized nature of transformer embeddings allows models to distinguish ambiguous morphological forms in many, but not all cases, and (iii) very specific attention head/layer combinations appear to hone in on subject-verb agreement.


title: SOPanG 2: online searching over a pan-genome without false positives

abstract: Motivation: The pan-genome can be stored as elastic-degenerate (ED) string, a recently introduced compact representation of multiple overlapping sequences. However, a search over the ED string does not indicate which individuals (if any) match the entire query. Results: We augment the ED string with sources (individuals' indexes) and propose an extension of the SOPanG (Shift-Or for Pan-Genome) tool to report only true positive matches, omitting those not occurring in any of the haplotypes. The additional stage for checking the matches yields a penalty of less than 3.5% relative speed in practice, which means that SOPanG 2 is able to report pattern matches in a pan-genome, mapping them onto individuals, at the single-thread throughput of above 430 MB/s on real data. Availability and implementation: SOPanG 2 can be downloaded here: github.com/MrAlexSee/sopang


title: The Role of Pragmatic and Discourse Context in Determining Argument Impact

abstract: Research in the social sciences and psychology has shown that the persuasiveness of an argument depends not only the language employed, but also on attributes of the source/communicator, the audience, and the appropriateness and strength of the argument's claims given the pragmatic and discourse context of the argument. Among these characteristics of persuasive arguments, prior work in NLP does not explicitly investigate the effect of the pragmatic and discourse context when determining argument quality. This paper presents a new dataset to initiate the study of this aspect of argumentation: it consists of a diverse collection of arguments covering 741 controversial topics and comprising over 47,000 claims. We further propose predictive models that incorporate the pragmatic and discourse context of argumentative claims and show that they outperform models that rely only on claim-specific linguistic features for predicting the perceived impact of individual claims within a particular line of argument.


title: Directional approach to gradual cover: the continuous case

abstract: The objective of the cover location models is covering demand by facilities within a given distance. The gradual (or partial) cover replaces abrupt drop from full cover to no cover by defining gradual decline in cover. In this paper we use a recently proposed rule for calculating the joint cover of a demand point by several facilities termed "directional gradual cover". Contrary to all gradual cover models, the joint cover depends on the facilities' directions. In order to calculate the joint cover, existing models apply the partial cover by each facility disregarding their direction. We develop a genetic algorithm to solve the facilities location problem and also solve the problem for facilities that can be located anywhere in the plane. The proposed modifications were extensively tested on a case study of covering Orange County, California.


title: Double Debiased Machine Learning Nonparametric Inference with Continuous Treatments

abstract: We propose a doubly robust inference method for causal effects of continuous treatment variables, under unconfoundedness and with nonparametric or high-dimensional nuisance functions. Our double debiased machine learning (DML) estimators for the average dose-response function (or the average structural function) and the partial effects are asymptotically normal with non-parametric convergence rates. The first-step estimators for the nuisance conditional expectation function and the conditional density can be nonparametric or ML methods. Utilizing a kernel-based doubly robust moment function and cross-fitting, we give high-level conditions under which the nuisance function estimators do not affect the first-order large sample distribution of the DML estimators. We provide sufficient low-level conditions for kernel, series, and deep neural networks. We justify the use of kernel to localize the continuous treatment at a given value by the Gateaux derivative. We implement various ML methods in Monte Carlo simulations and an empirical application on a job training program evaluation