title: Jensen Polynomials for the Riemann Xi Function

abstract: We investigate Riemann's xi function $\xi(s):=\frac{1}{2}s(s-1)\pi^{-\frac{s}{2}}\Gamma(\frac{s}{2})\zeta(s)$ (here $\zeta(s)$ is the Riemann zeta function). The Riemann Hypothesis (RH) asserts that if $\xi(s)=0$, then $\mathrm{Re}(s)=\frac{1}{2}$. P\'olya proved that RH is equivalent to the hyperbolicity of the Jensen polynomials $J^{d,n}(X)$ constructed from certain Taylor coefficients of $\xi(s)$. For each $d\geq 1$, recent work proves that $J^{d,n}(X)$ is hyperbolic for sufficiently large $n$. Here we make this result effective. Moreover, we show how the low-lying zeros of the derivatives $\xi^{(n)}(s)$ influence the hyperbolicity of $J^{d,n}(X)$.


title: $N=4$ superconformal algebras and diagonal cosets

abstract: Coset constructions of $\mathcal{W}$-algebras have many applications, and were recently given for principal $\mathcal{W}$-algebras of $A$, $D$, and $E$ types by Arakawa together with the first and third authors. In this paper, we give coset constructions of the large and small $N=4$ superconformal algebras, which are the minimal $\mathcal{W}$-algebras of $\mathfrak{d}(2,1;a)$ and $\mathfrak{psl}(2|2)$, respectively. From these realizations, one finds a remarkable connection between the large $N=4$ algebra and the diagonal coset $C^{k_1, k_2} = \text{Com}(V^{k_1+k_2}(\mathfrak{sl}_2), V^{k_1}(\mathfrak{sl}_2) \otimes V^{k_2}(\mathfrak{sl}_2))$, namely, as two-parameter vertex algebras, $C^{k_1, k_2}$ coincides with the coset of the large $N=4$ algebra by its affine subalgebra. We also show that at special points in the parameter space, the simple quotients of these cosets are isomorphic to various $\mathcal{W}$-algebras. As a corollary, we give new examples of strongly rational principal $\mathcal{W}$-algebras of type $C$ at degenerate admissible levels.


title: Plasmons and screening in finite-bandwidth 2D electron gas

abstract: The dynamical and nonlocal dielectric function of a two-dimensional electron gas (2DEG) with finite energy bandwidth is computed within random-phase approximation. For large bandwidth, the plasmon dispersion has two separate branches at small and large momenta. The large momenta branch exhibits negative quasi-flat dispersion. The two branches merge with decreasing bandwidth. We discuss how the maximum energy plasmon mode which resides at energies larger than all particle-hole continuum can potentially open a route to low-loss plasmons. Moreover, we discuss the bandwidth effects on the static screening of the charged and magnetic impurities.


title: Spin-Singlet and Spin-Triplet Josephson Junctions for Cryogenic Memory

abstract: Due to the ever increasing power and cooling requirements of large-scale computing and data facilities, there is a worldwide search for low-power alternatives to CMOS. One approach under consideration is superconducting computing based on single-flux-quantum logic. Unfortunately, there is not yet a low-power, high-density superconducting memory technology that is fully compatible with superconducting logic. We are working toward developing cryogenic memory based on Josephson junctions that contain two or more ferromagnetic (F) layers. Such junctions have been demonstrated to be programmable by changing the relative direction of the F layer magnetizations. There are at least two different types of such junctions -- those that carry the innate spin-singlet supercurrent associated with the conventional superconducting electrodes, and those that convert spin-singlet to spin-triplet supercurrent in the middle of the device. In this paper we compare the performance and requirements of the two kinds of junctions. Whereas the spin-singlet junctions need only two ferromagnetic layers to function, the spin-triplet junctions require at least three. In the devices demonstrated to date, the spin-singlet junctions have considerably larger critical current densities than the spin-triplet devices. On the other hand, the spin-triplet devices have less stringent constraints on the thicknesses of the F layers, which might be beneficial in large-scale manufacturing.


title: Plasmonic-based gas sensing with graphene nanoribbons

abstract: The main challenge to exploiting plasmons for gas vibrational mode sensing is the extremely weak infrared absorption of gas species. In this work, we explore the possibility of trapping free gas molecules via surface adsorption, optical, or electrostatic fields to enhance gas-plasmon interactions and to increase plasmon sensing ability. We discuss the relative strengths of these trapping forces and found gas adsorption in a typical nanoribbon array plasmonic setup produces measurable dips in optical extinction of magnitude 0.1 % for gas concentration of about parts per thousand level.


title: An Iterative Machine-Learning Framework for RANS Turbulence Modeling

abstract: Machine-learning (ML) techniques provide a new and encouraging perspective for constructing turbulence models for Reynolds-averaged Navier--Stokes (RANS) simulations. In this study, an iterative ML-RANS computational framework is proposed that combines an ML algorithm with transport equations of a conventional turbulence model. This framework maintains a consistent procedure for obtaining the input features of an ML model in both the training and predicting stages, ensuring a built-in reproducibility. The effective form of the closure term is discussed to determine suitable target variables for the ML algorithm, and the multi-valued problem of existing constitutive theory is studied to establish a proper regression system for ML algorithms. The developed ML model is trained under a cross-case strategy with data from turbulent channel flows at three Reynolds numbers and \textit{a posteriori} simulations of channel flows show that the framework is able to predict both the mean flow field and turbulent variables accurately. Interpolation tests for the channel flow show the proposed framework can reliably predict flow features that lie between the minimum and maximum Reynolds numbers associated with the training data. A further test related to the flow over periodic hills also demonstrates a better result than a traditional turbulence model, indicating a promising predictive capability of the developed ML model for separated flow even though the model is only trained with planar channel flow data.


title: New limits on neutrino non-standard mixings based on prescribed singular values

abstract: Singular values are used to construct physically admissible 3-dimensional mixing matrices characterized as contractions. Depending on the number of singular values strictly less than one, the space of the 3-dimensional mixing matrices can be split into four disjoint subsets, which accordingly corresponds to the minimal number of additional, non-standard neutrinos. We show in numerical analysis that taking into account present experimental precision and fits to different neutrino mass splitting schemes, it is not possible to distinguish, on the level of 3-dimensional mixing matrices, between two and three extra neutrino states. It means that in 3+2 and 3+3 neutrino mixing scenarios, using the so-called $\alpha$ parametrization, ranges of non-unitary mixings are the same. However, on the level of a complete unitary 3+1 neutrino mixing matrix, using the dilation procedure and the Cosine-Sine decomposition, we were able to shrink bounds for the "light-heavy" mixing matrix elements. For instance, in the so-called seesaw mass scheme, a new upper limit on $| U_{e4} | $ is about two times stringent than before and equals 0.021. For all considered mass schemes the lowest bounds are also obtained for all mixings, i.e. $| U_{e4} | , | U_{\mu 4} | , | U_{\tau 4} | .$ New results obtained in this work are based on analysis of neutrino mixing matrices obtained from the global fits at the 95% CL.


title: Microgrid Resilience: A holistic approach for assessing threats, identifying vulnerabilities, and designing corresponding mitigation strategies

abstract: Microgrids are being increasing deployed to improve the operational flexibility, resilience, coordinated-energy management capabilities, self-adequacy, and increased reliability of power systems. This strong market growth is also driven by advances in power electronics, improved control systems, and the rapidly falling price and increased adoption of distributed energy generation technologies, like solar photovoltaics and storage. In the event of grid outages, microgrids can provide a backup source of power; providing resilience to the critical loads; however, this requires that the microgrid itself is resilient to physical and cyber threats. Building highly resilient microgrids requires a methodological assessment of potential threats, identification of vulnerabilities, and design of mitigation strategies. This paper provides a comprehensive review of threats, vulnerabilities, and mitigation strategies and develops a definition for microgrid resilience. The paper also develops a methodology for designing resilient microgrids by considering how microgrid designers and site owners evaluate threats, vulnerabilities, and consequences and choose the microgrid features required to address these threats under different situations.


title: MXE: A package for simulating long-term diffusive mass transport phenomena in nanoscale systems

abstract: We present a package to simulate long-term diffusive mass transport in systems with atomic scale resolution. The implemented framework is based on a non-equilibrium statistical thermo-chemo-mechanical formulation of atomic systems where effective transport rates are computed by using kinematic diffusion laws. Our implementation is built as an add-on to the Large-scale Atomic/Molecular Massively Parallel Simulator (LAMMPS) code. It is compatible with other LAMMPS' functionalities, and shows a good parallel scalability and efficiency. In applications involving mass transport, our framework is able to simulate problems of technological interest for exceedingly large time scales using an atomistic description, which are not reachable with the \emph{state-of-the-art} molecular dynamics techniques. To validate the implementation, we investigated vacancy diffusion, vacancy assisted dislocation climb in metals at high-temperatures, segregation of solutes in free surfaces, diffusion of solutes to grain boundaries, and Hydrogen diffusion in Palladium nanowires. These examples were validated against known theories, methodologies or experimental results when possible, showing good agreement in all cases.


title: Weakly supervised segmentation from extreme points

abstract: Annotation of medical images has been a major bottleneck for the development of accurate and robust machine learning models. Annotation is costly and time-consuming and typically requires expert knowledge, especially in the medical domain. Here, we propose to use minimal user interaction in the form of extreme point clicks in order to train a segmentation model that can, in turn, be used to speed up the annotation of medical images. We use extreme points in each dimension of a 3D medical image to constrain an initial segmentation based on the random walker algorithm. This segmentation is then used as a weak supervisory signal to train a fully convolutional network that can segment the organ of interest based on the provided user clicks. We show that the network's predictions can be refined through several iterations of training and prediction using the same weakly annotated data. Ultimately, our method has the potential to speed up the generation process of new training datasets for the development of new machine learning and deep learning-based models for, but not exclusively, medical image analysis.


title: Distinct magneto-Raman signatures of spin-flip phase transitions in CrI3

abstract: The discovery of 2-dimensional (2D) materials, such as CrI3, that retain magnetic ordering at monolayer thickness has resulted in a surge of research in 2D magnetism from both pure and applied perspectives. Here, we report a magneto-Raman spectroscopy study on multilayered CrI3, focusing on two new features in the spectra which appear at temperatures below the magnetic ordering temperature and were previously assigned to high frequency magnons. We observe a striking evolution of the Raman spectra with increasing magnetic field in which clear, sudden changes in intensities of the modes are attributed to the interlayer ordering changing from antiferromagnetic to ferromagnetic at a critical magnetic field. Our work highlights the sensitivity of the Raman modes to weak interlayer spin ordering in CrI3. In addition, we theoretically examine potential origins for the new modes, which we deduce are unlikely single magnons.


title: Strong Dark Matter Self-Interaction from a Stable Scalar Mediator

abstract: In face of the small-scale structure problems of the collisionless cold dark matter (DM) paradigm, a popular remedy is to introduce a strong DM self-interaction which can be generated nonperturbatively by a MeV-scale light mediator. However, if such the mediator is unstable and decays into SM particles, the model is severely constrained by the DM direct and indirect detection experiments. In the present paper, we study a model of a self-interacting fermionic DM, endowed with a light stable scalar mediator. In this model, the DM relic abundance is dominated by the fermionic DM particle which is generated mainly via the freeze-out of its annihilations to the stable mediator. Since this channel is invisible, the DM indirect detection constraints should be greatly relaxed. Furthermore, the direct detection signals are suppressed to an unobservable level since fermionic DM scatterings with a nucleon appear at one-loop level. By further studying the bounds from the CMB and BBN on the visible channels involving the dark sector, we show that there is a large parameter space which can generate appropriate DM self-interactions at dwarf galaxy scales, while remaining compatible with other experimental constraints.


title: Undecidability, unit groups, and some totally imaginary infinite extensions of $\mathbb{Q}$

abstract: We produce new examples of totally imaginary infinite extensions of $\mathbb{Q}$ which have undecidable first-order theory by generalizing the methods used by Martinez-Ranero, Utreras and Videla for $\mathbb{Q}^{(2)}$. In particular, we use parametrized families of polynomials whose roots are totally real units to apply methods originally developed to prove the undecidability of totally real fields. This proves the undecidability of $\mathbb{Q}^{(d)}_{ab}$ for all $d \geq 2$.


title: Deep Reinforcement Learning for Single-Shot Diagnosis and Adaptation in Damaged Robots

abstract: Robotics has proved to be an indispensable tool in many industrial as well as social applications, such as warehouse automation, manufacturing, disaster robotics, etc. In most of these scenarios, damage to the agent while accomplishing mission-critical tasks can result in failure. To enable robotic adaptation in such situations, the agent needs to adopt policies which are robust to a diverse set of damages and must do so with minimum computational complexity. We thus propose a damage aware control architecture which diagnoses the damage prior to gait selection while also incorporating domain randomization in the damage space for learning a robust policy. To implement damage awareness, we have used a Long Short Term Memory based supervised learning network which diagnoses the damage and predicts the type of damage. The main novelty of this approach is that only a single policy is trained to adapt against a wide variety of damages and the diagnosis is done in a single trial at the time of damage.


title: Learning Dense Wide Baseline Stereo Matching for People

abstract: Existing methods for stereo work on narrow baseline image pairs giving limited performance between wide baseline views. This paper proposes a framework to learn and estimate dense stereo for people from wide baseline image pairs. A synthetic people stereo patch dataset (S2P2) is introduced to learn wide baseline dense stereo matching for people. The proposed framework not only learns human specific features from synthetic data but also exploits pooling layer and data augmentation to adapt to real data. The network learns from the human specific stereo patches from the proposed dataset for wide-baseline stereo estimation. In addition to patch match learning, a stereo constraint is introduced in the framework to solve wide baseline stereo reconstruction of humans. Quantitative and qualitative performance evaluation against state-of-the-art methods of proposed method demonstrates improved wide baseline stereo reconstruction on challenging datasets. We show that it is possible to learn stereo matching from synthetic people dataset and improve performance on real datasets for stereo reconstruction of people from narrow and wide baseline stereo data.


title: Cardiac Segmentation of LGE MRI with Noisy Labels

abstract: In this work, we attempt the segmentation of cardiac structures in late gadolinium-enhanced (LGE) magnetic resonance images (MRI) using only minimal supervision in a two-step approach. In the first step, we register a small set of five LGE cardiac magnetic resonance (CMR) images with ground truth labels to a set of 40 target LGE CMR images without annotation. Each manually annotated ground truth provides labels of the myocardium and the left ventricle (LV) and right ventricle (RV) cavities, which are used as atlases. After multi-atlas label fusion by majority voting, we possess noisy labels for each of the targeted LGE images. A second set of manual labels exists for 30 patients of the target LGE CMR images, but are annotated on different MRI sequences (bSSFP and T2-weighted). Again, we use multi-atlas label fusion with a consistency constraint to further refine our noisy labels if additional annotations in other modalities are available for a given patient. In the second step, we train a deep convolutional network for semantic segmentation on the target data while using data augmentation techniques to avoid over-fitting to the noisy labels. After inference and simple post-processing, we achieve our final segmentation for the targeted LGE CMR images, resulting in an average Dice of 0.890, 0.780, and 0.844 for LV cavity, LV myocardium, and RV cavity, respectively.


title: The interface between the outer heliosphere and the inner lism: Morphology of the local interstellar cloud, its hydrogen hole, stromgren shells, and $^{60}$Fe accretion

abstract: We describe the interface between the outer heliosphere and the local interstellar medium (LISM) surrounding the Sun. The components of the inner LISM are the four partially ionized clouds [the Local Interstellar Cloud (LIC), G cloud, Blue cloud, and Aql cloud] that are in contact with the outer heliosphere, and ionized gas produced by EUV radiation primarily from $\epsilon$~CMa. We construct the three-dimensional shape of the LIC based on interstellar line absorption along 62 sightlines and show that in the direction of $\epsilon$~CMa, $\beta$~CMa, and Sirius~B the neutral hydrogen column density from the center of the LIC is a minimum. We call this region the ``hydrogen hole''. In this direction, the presence of Blue cloud absorption and the absence of LIC absorption can be simply explained by the Blue cloud lying just outside of the heliosphere. We propose that the outer edge of the Blue cloud is a Str\"omgren shell driven toward the heliosphere by high pressures in the H~II region. We find that the vectors of neutral and ionized helium flowing through the heliosphere are inconsistent with the LIC flow vector, and that the nearby intercloud gas is consistent with ionization by $\epsilon$~CMa and other stellar sources without requiring additional sources of ionization or million degree plasma. In the upwind direction, the heliosphere is passing through an environment of several LISM clouds, which may explain the recent influx of interstellar grains containing $^{60}$Fe from supernova ejecta measured in Antarctica snow.


title: Linking artificial and human neural representations of language

abstract: What information from an act of sentence understanding is robustly represented in the human brain? We investigate this question by comparing sentence encoding models on a brain decoding task, where the sentence that an experimental participant has seen must be predicted from the fMRI signal evoked by the sentence. We take a pre-trained BERT architecture as a baseline sentence encoding model and fine-tune it on a variety of natural language understanding (NLU) tasks, asking which lead to improvements in brain-decoding performance. We find that none of the sentence encoding tasks tested yield significant increases in brain decoding performance. Through further task ablations and representational analyses, we find that tasks which produce syntax-light representations yield significant improvements in brain decoding performance. Our results constrain the space of NLU models that could best account for human neural representations of language, but also suggest limits on the possibility of decoding fine-grained syntactic information from fMRI human neuroimaging.


title: Relativistic reflection and reverberation in GX 339-4 with NICER and NuSTAR

abstract: We analyze seven NICER and NuSTAR epochs of the black hole X-ray binary GX 339-4 in the hard state during its two most recent hard-only outbursts in 2017 and 2019. These observations cover the 1-100 keV unabsorbed luminosities between 0.3% and 2.1% of the Eddington limit. With NICER's negligible pile-up, high count rate and unprecedented time resolution, we perform a spectral-timing analysis and spectral modeling using relativistic and distant reflection models. Our spectral fitting shows that as the inner disk radius moves inwards, the thermal disk emission increases in flux and temperature, the disk becomes more highly ionized and the reflection fraction increases. This coincides with the inner disk increasing its radiative efficiency around ~1% Eddington. We see a hint of hysteresis effect at ~0.3% of Eddington: the inner radius is significantly truncated during the rise ($>49R_{g}$), while only a mild truncation ($\sim5R_g$) is found during the decay. At higher frequencies ($2-7$~Hz) in the highest luminosity epoch, a soft lag is present, whose energy dependence reveals a thermal reverberation lag, with an amplitude similar to previous findings for this source. We also discuss the plausibility of the hysteresis effect and the debate of the disk truncation problem in the hard state.


title: Strong Coupling Thermodynamics of Open Quantum Systems

abstract: A general thermodynamic framework is presented for open quantum systems in fixed contact with a thermal reservoir. The first and second law are obtained for arbitrary system-reservoir coupling strengths, and including both factorized and correlated initial conditions. The thermodynamic properties are adapted to the generally strong coupling regime, approaching the ones defined for equilibrium, and their standard weak-coupling counterparts as appropriate limits. Moreover, they can be inferred from measurements involving only system observables. Finally, a thermodynamic signature of non-Markovianity is formulated in the form of a negative entropy production rate.


title: Coded Merkle Tree: Solving Data Availability Attacks in Blockchains

abstract: In this paper, we propose coded Merkle tree (CMT), a novel hash accumulator that offers a constant-cost protection against data availability attacks in blockchains, even if the majority of the network nodes are malicious. A CMT is constructed using a family of sparse erasure codes on each layer, and is recovered by iteratively applying a peeling-decoding technique that enables a compact proof for data availability attack on any layer. Our algorithm enables any node to verify the full availability of any data block generated by the system by just downloading a $\Theta(1)$ byte block hash commitment and randomly sampling $\Theta(\log b)$ bytes, where $b$ is the size of the data block. With the help of only one connected honest node in the system, our method also allows any node to verify any tampering of the coded Merkle tree by just downloading $\Theta(\log b)$ bytes. We provide a modular library for CMT in Rust and Python and demonstrate its efficacy inside the Parity Bitcoin client.


title: High-precision calculation of the 4-loop QED contribution to the slope of the Dirac form factor

abstract: We have evaluated with 1100 digits of precision the contribution of all the 891 mass-independent four-loop Feynman diagrams contributing to the slope of the Dirac form factor in QED. The total 4-loop contribution is $ m^2 F_1^{(4)'}(0) = 0.886545673946443145836821730610315359390424032660064745... \left(\frac{\alpha}{\pi}\right)^4$. We have fit a semi-analytical expression to the numerical value. The expression contains harmonic polylogarithms of argument $e^{\frac{i\pi}{3}}$, $e^{\frac{2i\pi}{3}}$, $e^{\frac{i\pi}{2}}$, one-dimensional integrals of products of complete elliptic integrals and six finite parts of master integrals, evaluated up to 4800 digits. I show the correction on the shift of the energy levels of the hydrogen atom due to the slope.


title: Analyzing the Variance of Policy Gradient Estimators for the Linear-Quadratic Regulator

abstract: We study the variance of the REINFORCE policy gradient estimator in environments with continuous state and action spaces, linear dynamics, quadratic cost, and Gaussian noise. These simple environments allow us to derive bounds on the estimator variance in terms of the environment and noise parameters. We compare the predictions of our bounds to the empirical variance in simulation experiments.


title: Optimal Patrolling of High Priority Segments While Visiting the Unit Interval with a Set of Mobile Robots

abstract: Consider a region that requires to be protected from unauthorized penetrations. The border of the region, modeled as a unit line segment, consists of high priority segments that require the highest level of protection separated by low priority segments that require to be visited infinitely often. We study the problem of patrolling the border with a set of $k$ robots. The goal is to obtain a strategy that minimizes the maximum idle time (the time that a point is left unattended) of the high priority points while visiting the low priority points infinitely often. We use the concept of single lid cover (segments of fixed length) where each high priority point is covered with at least one lid, and then we extend it to strong double-lid cover where each high priority point is covered with at least two lids, and the unit line segment is fully covered. Let $\lambda_{k-1}$ be the minimum lid length that accepts a single $\lambda_{k-1}$-lid cover with $k-1$ lids and $\Lambda_{2k}$ be the minimum lid length that accepts a strong double $\Lambda_{2k}$-lid cover with $2k$ lids. We show that $2\min(\Lambda_{2k}, \lambda_{k-1})$ is the lower bound of the idle time when the max speed of the robots is one. To compute $\Lambda_{2k}$ and $\lambda_{k-1}$, we present an algorithm with time complexity $O(\max(k, n)\log{n})$ where $n$ is the number of high priority sections. For the upper bound, first we present a strategy with idle time $\lambda_{k-1}$ where one robot covers the unit line, and the remaining robots cover the lids of a single $\lambda_{k-1}$-lid cover with $k-1$ lids. Then, we present a simple strategy with idle time $3\Lambda_{2k}$ that splits the unit line into not-disjoint $k$ segments of equal length that robots synchronously cover. Then, we present a complex strategy that split the unit line into $k$ non-disjoint segments that robots asynchronously cover.


title: Search problems in algebraic complexity, GCT, and hardness of generator for invariant rings

abstract: We consider the problem of computing succinct encodings of lists of generators for invariant rings for group actions. Mulmuley conjectured that there are always polynomial sized such encodings for invariant rings of $\SL_n(\C)$-representations. We provide simple examples that disprove this conjecture (under standard complexity assumptions). We develop a general framework, denoted \emph{algebraic circuit search problems}, that captures many important problems in algebraic complexity and computational invariant theory. This framework encompasses various proof systems in proof complexity and some of the central problems in invariant theory as exposed by the Geometric Complexity Theory (GCT) program, including the aforementioned problem of computing succinct encodings for generators for invariant rings.


title: Rogue Waves and Periodic Solutions of a Nonlocal Nonlinear Schr\"odinger Model

abstract: In the present work, a nonlocal nonlinear Schr\"odinger (NLS) model is studied by means of a recent technique that identifies solutions of partial differential equations, by considering them as fixed points in {\it space-time}. This methodology allows to perform a continuation of well-known solutions of the local NLS model to the nonlocal case. Four different examples of this type are presented, namely (a) the rogue wave in the form of the Peregrine soliton, (b) the generalization thereof in the form of the Kuznetsov-Ma breather, as well as two spatio-temporally periodic solutions in the form of elliptic functions. Importantly, all four waveforms can be continued in intervals of the parameter controlling the nonlocality of the model. The first two can be continued in a narrower interval, while the periodic ones can be extended to arbitrary nonlocalities and, in fact, present an intriguing bifurcation whereby they merge with (only) spatially periodic structures. The results suggest the generic relevance of rogue waves and related structures, as well as periodic solutions, in nonlocal NLS models.


title: Efficient and robust signal sensing by sequences of adiabatic chirped pulses

abstract: We propose a scheme for sensing of an oscillating field in systems with large inhomogeneous broadening and driving field variation by applying sequences of phased, adiabatic, chirped pulses. The latter act as a double filter for dynamical decoupling, where the adiabatic changes of the mixing angle during the pulses rectify the signal and partially remove frequency noise. The sudden changes between the pulses act as instantaneous $\pi$ pulses in the adiabatic basis for additional noise suppression. We also use the pulses' phases to correct for other errors, e.g., due to non-adiabatic couplings. Our technique improves significantly the coherence time in comparison to standard XY8 dynamical decoupling in realistic simulations in NV centers with large inhomogeneous broadening and is suitable for experimental implementations with substantial driving field inhomogeneity. Beyond the theoretical proposal, we also present proof-of-principle experimental results for quantum sensing of an oscillating field in NV centers in diamond, demonstrating superior performance compared to the standard technique.


title: Emotion Recognition with Spatial Attention and Temporal Softmax Pooling

abstract: Video-based emotion recognition is a challenging task because it requires to distinguish the small deformations of the human face that represent emotions, while being invariant to stronger visual differences due to different identities. State-of-the-art methods normally use complex deep learning models such as recurrent neural networks (RNNs, LSTMs, GRUs), convolutional neural networks (CNNs, C3D, residual networks) and their combination. In this paper, we propose a simpler approach that combines a CNN pre-trained on a public dataset of facial images with (1) a spatial attention mechanism, to localize the most important regions of the face for a given emotion, and (2) temporal softmax pooling, to select the most important frames of the given video. Results on the challenging EmotiW dataset show that this approach can achieve higher accuracy than more complex approaches.


title: Distillation $\approx$ Early Stopping? Harvesting Dark Knowledge Utilizing Anisotropic Information Retrieval For Overparameterized Neural Network

abstract: Distillation is a method to transfer knowledge from one model to another and often achieves higher accuracy with the same capacity. In this paper, we aim to provide a theoretical understanding on what mainly helps with the distillation. Our answer is "early stopping". Assuming that the teacher network is overparameterized, we argue that the teacher network is essentially harvesting dark knowledge from the data via early stopping. This can be justified by a new concept, {Anisotropic Information Retrieval (AIR)}, which means that the neural network tends to fit the informative information first and the non-informative information (including noise) later. Motivated by the recent development on theoretically analyzing overparameterized neural networks, we can characterize AIR by the eigenspace of the Neural Tangent Kernel(NTK). AIR facilities a new understanding of distillation. With that, we further utilize distillation to refine noisy labels. We propose a self-distillation algorithm to sequentially distill knowledge from the network in the previous training epoch to avoid memorizing the wrong labels. We also demonstrate, both theoretically and empirically, that self-distillation can benefit from more than just early stopping. Theoretically, we prove convergence of the proposed algorithm to the ground truth labels for randomly initialized overparameterized neural networks in terms of $\ell_2$ distance, while the previous result was on convergence in $0$-$1$ loss. The theoretical result ensures the learned neural network enjoy a margin on the training data which leads to better generalization. Empirically, we achieve better testing accuracy and entirely avoid early stopping which makes the algorithm more user-friendly.


title: ANDA: A Novel Data Augmentation Technique Applied to Salient Object Detection

abstract: In this paper, we propose a novel data augmentation technique (ANDA) applied to the Salient Object Detection (SOD) context. Standard data augmentation techniques proposed in the literature, such as image cropping, rotation, flipping, and resizing, only generate variations of the existing examples, providing a limited generalization. Our method has the novelty of creating new images, by combining an object with a new background while retaining part of its salience in this new context; To do so, the ANDA technique relies on the linear combination between labeled salient objects and new backgrounds, generated by removing the original salient object in a process known as image inpainting. Our proposed technique allows for more precise control of the object's position and size while preserving background information. Aiming to evaluate our proposed method, we trained multiple deep neural networks and compared the effect that our technique has in each one. We also compared our method with other data augmentation techniques. Our findings show that depending on the network improvement can be up to 14.1% in the F-measure and decay of up to 2.6% in the Mean Absolute Error.


title: Superfluid Condensate Fraction and Pairing Wave Function of the Unitary Fermi Gas

abstract: The unitary Fermi gas is a many-body system of two-component fermions with zero-range interactions tuned to infinite scattering length. Despite much activity and interest in unitary Fermi gases and its universal properties, there have been great difficulties in performing accurate calculations of the superfluid condensate fraction and pairing wave function. In this work we present auxiliary-field lattice Monte Carlo simulations using a novel lattice interaction which accelerates the approach to the continuum limit, thereby allowing for robust calculations of these difficult observables. As a benchmark test we compute the ground state energy of 33 spin-up and 33 spin-down particles. As a fraction of the free Fermi gas energy $E_{FG}$, we find $E_0/E_{FG}= 0.369(2), 0.372(2)$, using two different definitions of the finite-system energy ratio, in agreement with the latest theoretical and experimental results. We then determine the condensate fraction by measuring off-diagonal long-range order in the two-body density matrix. We find that the fraction of condensed pairs is $\alpha = 0.43(2)$. We also extract the pairing wave function and find the pair correlation length to be $\zeta_pk_F = 1.8(3) \hbar$, where $k_F$ is the Fermi momentum. Provided that the simulations can be performed without severe sign oscillations, the methods we present here can be applied to superfluid neutron matter as well as more exotic P-wave and D-wave superfluids.


title: Integrating Machine Learning and Multiscale Modeling: Perspectives, Challenges, and Opportunities in the Biological, Biomedical, and Behavioral Sciences

abstract: Fueled by breakthrough technology developments, the biological, biomedical, and behavioral sciences are now collecting more data than ever before. There is a critical need for time- and cost-efficient strategies to analyze and interpret these data to advance human health. The recent rise of machine learning as a powerful technique to integrate multimodality, multifidelity data, and reveal correlations between intertwined phenomena presents a special opportunity in this regard. However, classical machine learning techniques often ignore the fundamental laws of physics and result in ill-posed problems or non-physical solutions. Multiscale modeling is a successful strategy to integrate multiscale, multiphysics data and uncover mechanisms that explain the emergence of function. However, multiscale modeling alone often fails to efficiently combine large data sets from different sources and different levels of resolution. We show how machine learning and multiscale modeling can complement each other to create robust predictive models that integrate the underlying physics to manage ill-posed problems and explore massive design spaces. We critically review the current literature, highlight applications and opportunities, address open questions, and discuss potential challenges and limitations in four overarching topical areas: ordinary differential equations, partial differential equations, data-driven approaches, and theory-driven approaches. Towards these goals, we leverage expertise in applied mathematics, computer science, computational biology, biophysics, biomechanics, engineering mechanics, experimentation, and medicine. Our multidisciplinary perspective suggests that integrating machine learning and multiscale modeling can provide new insights into disease mechanisms, help identify new targets and treatment strategies, and inform decision making for the benefit of human health.


title: Joint Survey Processing of LSST, Euclid and WFIRST: Enabling a broad array of astrophysics and cosmology through pixel level combinations of datasets

abstract: Joint survey processing (JSP) is the pixel level combination of LSST, Euclid, and WFIRST datasets. By combining the high spatial resolution of the space-based datasets with deep, seeing-limited, ground-based images in the optical bands, systematics like source confusion and astrometric mismatch can be addressed to derive the highest precision optical/infrared photometric catalogs. This white paper highlights the scientific motivation, computational and algorithmic needs to build joint pixel level processing capabilities, which the individual projects by themselves will not be able to support. Through this white paper, we request that the Astro2020 decadal committee recognize the JSP effort as a multi-agency project with the natural outcome being a collaborative effort among groups which are normally supported by a single agency. JSP will allow the U.S. (and international) astronomical community to manipulate the flagship data sets and undertake innovative science investigations ranging from solar system object characterization, exoplanet detections, nearby galaxy rotation rates and dark matter properties, to epoch of reionization studies. It will also result in the ultimate constraints on cosmological parameters and the nature of dark energy, with far smaller uncertainties and a better handle on systematics than by any one survey alone.


title: Space-time reduced order model for large-scale linear dynamical systems with application to Boltzmann transport problems

abstract: A classical reduced order model for dynamical problems involves spatial reduction of the problem size. However, temporal reduction accompanied by the spatial reduction can further reduce the problem size without losing accuracy much, which results in a considerably more speed-up than the spatial reduction only. Recently, a novel space-time reduced order model for dynamical problems has been developed, where the space-time reduced order model shows an order of a hundred speed-up with a relative error of less than 0.1% for small academic problems. However, in order for the method to be applicable to a large-scale problem, an efficient space-time reduced basis construction algorithm needs to be developed. We present incremental space-time reduced basis construction algorithm. The incremental algorithm is fully parallel and scalable. Additionally, the block structure in the space-time reduced basis is exploited, which enables the avoidance of constructing the reduced space-time basis. These novel techniques are applied to a large-scale particle transport simulation with million and billion degrees of freedom. The numerical example shows that the algorithm is scalable and practical. Also, it achieves a tremendous speed-up, maintaining a good accuracy. Finally, error bounds for space-only and space-time reduced order models are derived.


title: Positive Ion Chemistry in an N$_2$-CH$_4$ Plasma Discharge: Key Precursors to the Growth of Titan Tholins

abstract: Titan is unique in the solar system as it hosts a dense atmosphere mainly made of N$_2$ and CH$_4$. Cassini-Huygens revealed the presence of an intense atmospheric photochemistry initiated by the photo-dissociation and ionization of N$_2$ and CH$_4$. In the upper atmosphere, Cassini detected signatures compatible with the presence of heavily charged molecules, precursors for the solid core of the aerosols. However, the processes coupling ion chemistry and aerosol formation and growth are still mostly unknown. In this study, we investigated the cation chemistry responsible for an efficient organic growth that we observe in Titan's upper atmosphere, simulated using the PAMPRE plasma reactor. Cation precursors were measured by in situ ion mass spectrometry in a cold plasma and compared with INMS observations taken during the T40 flyby. A series of positive ion measurements were performed in three CH$_4$ mixing ratios (1%, 5% and 10%) showing a variability in ion population. Low CH$_4$ concentrations result in an abundance of amine cations such as NH$_4^+$ whereas aliphatic compounds dominate at higher methane concentrations. In conditions of favored tholin production, the presence of C2 compounds such as HCNH$^+$ and C$_2$H$_5^+$ is found to be consistent with copolymeric growth structures seen in tholin material. The observed abundance of these two ions particularly in conditions with lower CH$_4$ amounts is consistent with modeling work simulating aerosol growth in Titan's ionosphere, which includes mass exchange primarily between HCNH$^+$ and C$_2$H$_5^+$ and negatively charged particles. These results also confirm the prevalent role of C2 cations as precursors to molecular growth and subsequent mass transfer to the charged aerosol particles as the CH$_4$ abundance decreases towards lower altitudes.


title: Quantum tensor singular value decomposition with applications to recommendation systems

abstract: In this paper, we present a quantum singular value decomposition algorithm for third-order tensors inspired by the classical algorithm of tensor singular value decomposition (t-svd) and then extend it to order-$p$ tensors. It can be proved that the quantum version of the t-svd for a third-order tensor $\mathcal{A} \in \mathbb{R}^{N\times N \times N}$ achieves the complexity of $\mathcal{O}(N{\rm polylog}(N))$, an exponential speedup compared with its classical counterpart. As an application, we propose a quantum algorithm for recommendation systems which incorporates the contextual situation of users to the personalized recommendation. We provide recommendations varying with contexts by measuring the output quantum state corresponding to an approximation of this user's preferences. This algorithm runs in expected time $\mathcal{O}(N{\rm polylog}(N){\rm poly}(k)),$ if every frontal slice of the preference tensor has a good rank-$k$ approximation. At last, we provide a quantum algorithm for tensor completion based on a different truncation method which is tested to have a good performance in dynamic video completion.


title: Hall algebras and quantum symmetric pairs III: Quiver varieties

abstract: The $\imath$quiver algebras were introduced recently by the authors to provide a Hall algebra realization of universal $\imath$quantum groups, which is a generalization of Bridgeland's Hall algebra construction for (Drinfeld doubles of) quantum groups; here an $\imath$quantum group and a corresponding Drinfeld-Jimbo quantum group form a quantum symmetric pair. In this paper, the Dynkin $\imath$quiver algebras are shown to arise as new examples of singular Nakajima-Keller-Scherotzke categories. Then we provide a geometric construction of the universal $\imath$quantum groups and their ``dual canonical bases" with positivity, via the quantum Grothendieck rings of Nakajima-Keller-Scherotzke quiver varieties, generalizing Qin's geometric realization of quantum groups of type ADE.


title: Flows Over Periodic Hills of Parameterized Geometries: A Dataset for Data-Driven Turbulence Modeling From Direct Simulations

abstract: Computational fluid dynamics models based on Reynolds-averaged Navier--Stokes equations with turbulence closures still play important roles in engineering design and analysis. However, the development of turbulence models has been stagnant for decades. With recent advances in machine learning, data-driven turbulence models have become attractive alternatives worth further explorations. However, a major obstacle in the development of data-driven turbulence models is the lack of training data. In this work, we survey currently available public turbulent flow databases and conclude that they are inadequate for developing and validating data-driven models. Rather, we need more benchmark data from systematically and continuously varied flow conditions (e.g., Reynolds number and geometry) with maximum coverage in the parameter space for this purpose. To this end, we perform direct numerical simulations of flows over periodic hills with varying slopes, resulting in a family of flows over periodic hills which ranges from incipient to mild and massive separations. We further demonstrate the use of such a dataset by training a machine learning model that predicts Reynolds stress anisotropy based on a set of mean flow features. We expect the generated dataset, along with its design methodology and the example application presented herein, will facilitate development and comparison of future data-driven turbulence models.


title: Investigation of the Origin of the Anomalous Microwave Emission in Lambda Orionis

abstract: The anomalous microwave emission (AME) still lacks a conclusive explanation. This excess of emission, roughly between 10 and 50 GHz, tends to defy attempts to explain it as synchrotron or free-free emission. The overlap with frequencies important for cosmic microwave background explorations, combined with a strong correlation with interstellar dust, drive cross-disciplinary collaboration between interstellar medium and observational cosmology. The apparent relationship with dust has prompted a ``spinning dust'' hypothesis. The typical peak frequency range of the AME profile implicates spinning grains on the order of 1 nm. This points to polycyclic aromatic hydrocarbons (PAHs). We use data from the AKARI/Infrared Camera (IRC), due to its thorough PAH-band coverage, to compare AME from the Planck Collaboration astrophysical component separation product with infrared dust emission in the Orionis AME-prominent region. We look also at infrared dust emission from other mid IR and far-IR bands. The results and discussion contained here apply to an angular scale of approximately 1{\deg}. We find that certainly dust mass correlates with AME, and that PAH-related emission in the AKARI/IRC 9 {\mu}m band correlates slightly more strongly. Using hierarchical Bayesian inference and full dust spectral energy distribution (SED) modeling we argue that AME in {\lambda}Orionis correlates more strongly with PAH mass than with total dust mass, lending support for a spinning PAH hypothesis within this region. We emphasize that future efforts to understand AME should focus on individual regions, and a detailed comparison of the PAH features with the variation of the AME SED.


title: Anharmonicity strongly enhancing thermal interface conductance: A new anharmonic atomistic Green's function formalism

abstract: The traditional atomistic Green's function (AGF) was formulated in the harmonic regime, preventing it from capturing the role of anharmonicity in interfacial thermal transport. Incorporating anharmonicity into AGF has long been desired but remains challenging. We developed a rigorous anharmonic AGF model to incorporate anharmonicity at interfaces in 3-D structures with first-principles force constants. Thermal conductance of silicon- and aluminum-based interfaces is significantly enhanced resulting from the new channels opened by inelastic scattering. This work represents a major step forward for AGF and highlights the importance of anharmonicity at the interface.


title: RKKY interactions of CeB6 based on effective Wannier model

abstract: We examine the RKKY interactions of CeB$_6$ between multipole moments based on the effective Wannier model obtained from the bandstructure calculation including 14 Ce-$f$ orbitals and 60 conduction orbitals of Ce-$d,s$ and B-$p,s$. By using the $f$-$c$ mixing matrix elements of the Wannier model together with the conduction band dispersion, the multipole couplings with the RKKY oscillation are obtained for the active moments in $\Gamma_{8}$ subspace. Both of the $\Gamma_{5g}$ quadrupole $O_{xy}$ and the $\Gamma_{2u}$ octupole $T_{xyz}$ couplings are largely enhanced with $\bm{q}=(\pi,\pi,\pi)$ which naturally explains the antiferro-quadrupolar phase of the phase II, and are also enhanced with $\bm{q}=(0,0,0)$ corresponding to the elastic softening of $C_{44}$. Also the couplings of the $\Gamma_{5u}$ octupole $T_{z}^{\beta}$ is quite large for $\bm{q}=(0,0,\pi)$ which is related to the antiferro-octupolar ordering of a possible candidate for the phase IV of Ce$_{x}$La$_{1-x}$B$_6$.


title: Kidney Recognition in CT Using YOLOv3

abstract: Organ localization can be challenging considering the heterogeneity of medical images and the biological diversity from one individual to another. The contribution of this paper is to overview the performance of the object detection model, YOLOv3, on kidney localization in 2D and in 3D from CT scans. The model obtained a 0.851 Dice score in 2D and 0.742 in 3D. The SSD, a similar state-of-the-art object detection model, showed similar scores on the test set. YOLOv3 and SSD demonstrated the ability to detect kidneys on a wide variety of CT scans including patients suffering from different renal conditions.


title: Learning Point Embeddings from Shape Repositories for Few-Shot Segmentation

abstract: User generated 3D shapes in online repositories contain rich information about surfaces, primitives, and their geometric relations, often arranged in a hierarchy. We present a framework for learning representations of 3D shapes that reflect the information present in this meta data and show that it leads to improved generalization for semantic segmentation tasks. Our approach is a point embedding network that generates a vectorial representation of the 3D points such that it reflects the grouping hierarchy and tag data. The main challenge is that the data is noisy and highly variable. To this end, we present a tree-aware metric-learning approach and demonstrate that such learned embeddings offer excellent transfer to semantic segmentation tasks, especially when training data is limited. Our approach reduces the relative error by $10.2\%$ with $8$ training examples, by $11.72\%$ with $120$ training examples on the ShapeNet semantic segmentation benchmark, in comparison to the network trained from scratch. By utilizing tag data the relative error is reduced by $12.8\%$ with $8$ training examples, in comparison to the network trained from scratch. These improvements come at no additional labeling cost as the meta data is freely available.


title: Can Automated Program Repair Refine Fault Localization?

abstract: Software bugs are prevalent in modern software systems and notoriously hard to debug manually. Therefore, a large body of research efforts have been dedicated to automated software debugging, including both automated fault localization and program repair. However, the existing fault localization techniques are usually ineffective on real-world software systems while even the most advanced program repair techniques can only fix a small ratio of real-world bugs. Although fault localization and program repair are inherently connected, we observe that in the literature their only connection is that program repair techniques usually use off-the-shelf fault localization techniques (e.g., Ochiai) to determine the potential candidate statements/elements for patching. In this work, we explore their connection in the other direction, i.e., can program repair in turn help with fault localization? In this way,we not only open a new dimension for more powerful fault localization, but also extend the application scope of program repair to all possible bugs (not only the bugs that can be directly automatically fixed).We have designed ProFL, a simplistic approach using patch-execution results (from program repair) as the feedback information for fault localization. The experimental results on the widely used Defects4J benchmark show that the basic ProFL can already localize 161 of the 395 studied bugs within Top-1, while state-of-the-art spectrum and mutation based fault localization techniques at most localize 117 within Top-1. We also demonstrate ProFL's effectiveness under different settings. Lastly, we show that ProFL can further boost state-of-the-art fault localization via both unsupervised and supervised learning.


title: YOLO Nano: a Highly Compact You Only Look Once Convolutional Neural Network for Object Detection

abstract: Object detection remains an active area of research in the field of computer vision, and considerable advances and successes has been achieved in this area through the design of deep convolutional neural networks for tackling object detection. Despite these successes, one of the biggest challenges to widespread deployment of such object detection networks on edge and mobile scenarios is the high computational and memory requirements. As such, there has been growing research interest in the design of efficient deep neural network architectures catered for edge and mobile usage. In this study, we introduce YOLO Nano, a highly compact deep convolutional neural network for the task of object detection. A human-machine collaborative design strategy is leveraged to create YOLO Nano, where principled network design prototyping, based on design principles from the YOLO family of single-shot object detection network architectures, is coupled with machine-driven design exploration to create a compact network with highly customized module-level macroarchitecture and microarchitecture designs tailored for the task of embedded object detection. The proposed YOLO Nano possesses a model size of ~4.0MB (>15.1x and >8.3x smaller than Tiny YOLOv2 and Tiny YOLOv3, respectively) and requires 4.57B operations for inference (>34% and ~17% lower than Tiny YOLOv2 and Tiny YOLOv3, respectively) while still achieving an mAP of ~69.1% on the VOC 2007 dataset (~12% and ~10.7% higher than Tiny YOLOv2 and Tiny YOLOv3, respectively). Experiments on inference speed and power efficiency on a Jetson AGX Xavier embedded module at different power budgets further demonstrate the efficacy of YOLO Nano for embedded scenarios.


title: Astronomy in a Low-Carbon Future

abstract: The global climate crisis poses new risks to humanity, and with them, new challenges to the practices of professional astronomy. Avoiding the more catastrophic consequences of global warming by more than 1.5 degrees requires an immediate reduction of greenhouse gas emissions. According to the 2018 United Nations Intergovernmental Panel report, this will necessitate a 45% reduction of emissions by 2030 and net-zero emissions by 2050. Efforts are required at all levels, from the individual to the governmental, and every discipline must find ways to achieve these goals. This will be especially difficult for astronomy with its significant reliance on conference and research travel, among other impacts. However, our long-range planning exercises provide the means to coordinate our response on a variety of levels. We have the opportunity to lead by example, rising to the challenge rather than reacting to external constraints. We explore how astronomy can meet the challenge of a changing climate in clear and responsible ways, such as how we set expectations (for ourselves, our institutions, and our granting agencies) around scientific travel, the organization of conferences, and the design of our infrastructure. We also emphasize our role as reliable communicators of scientific information on a problem that is both human and planetary in scale.

categories: astro-ph.IM astro-ph.CO astro-ph.EP astro-ph.GA astro-ph.HE


title: Holographic Approaches to DIS on a Nucleus

abstract: We consider deep inelastic scattering (DIS) on a dense nucleus described as an extremal RN-AdS black hole with holographic quantum fermions in the bulk. We find that the R-ratio (the ratio of the structure function of the black hole to proton) exhibit shadowing for $x < 0.1$, anti-shadowing for $0.1 < x < 0.3$, EMC-like effect for $0.3 < x < 0.8$ and Fermi motion for $x > 0.8$ in a qualitative agreement with the experimental observation of the ratio for DIS on nucleus for all range of $x$. We also take the dilute limit of the black hole and show that its R-ratio exhibits EMC-like effect for $0.2 < x < 0.8$ and the Fermi motion for $x > 0.8$, and no shadowing is observed in the dilute limit for both bottom-up (using Thomas-Fermi approximation for the nucleon distribution inside the dilute nucleus), and top-down (considering the dilute nucleus to be a Fermi gas in AdS) approaches.


title: Extracting UMLS Concepts from Medical Text Using General and Domain-Specific Deep Learning Models

abstract: Entity recognition is a critical first step to a number of clinical NLP applications, such as entity linking and relation extraction. We present the first attempt to apply state-of-the-art entity recognition approaches on a newly released dataset, MedMentions. This dataset contains over 4000 biomedical abstracts, annotated for UMLS semantic types. In comparison to existing datasets, MedMentions contains a far greater number of entity types, and thus represents a more challenging but realistic scenario in a real-world setting. We explore a number of relevant dimensions, including the use of contextual versus non-contextual word embeddings, general versus domain-specific unsupervised pre-training, and different deep learning architectures. We contrast our results against the well-known i2b2 2010 entity recognition dataset, and propose a new method to combine general and domain-specific information. While producing a state-of-the-art result for the i2b2 2010 task (F1 = 0.90), our results on MedMentions are significantly lower (F1 = 0.63), suggesting there is still plenty of opportunity for improvement on this new data.


title: A Neural Network for Detailed Human Depth Estimation from a Single Image

abstract: This paper presents a neural network to estimate a detailed depth map of the foreground human in a single RGB image. The result captures geometry details such as cloth wrinkles, which are important in visualization applications. To achieve this goal, we separate the depth map into a smooth base shape and a residual detail shape and design a network with two branches to regress them respectively. We design a training strategy to ensure both base and detail shapes can be faithfully learned by the corresponding network branches. Furthermore, we introduce a novel network layer to fuse a rough depth map and surface normals to further improve the final result. Quantitative comparison with fused `ground truth' captured by real depth cameras and qualitative examples on unconstrained Internet images demonstrate the strength of the proposed method. The code is available at https://github.com/sfu-gruvi-3dv/deep_human.


title: Impact of high Q on ILC250 upgrade for record luminosities and path toward ILC380

abstract: In this paper, we address the possibility of upgrading the ILC250 luminosity to $8.1 \times 10^{34}$, so that with the polarization feature, the effective luminosity will be $2.0 \times 10^{35}$ to compete with the FCC-ee luminosity and two detectors. The additional cost of the higher luminosity option will be about 2.2 B ILCU. The total cost for the ILC high luminosity machine will therefore be about 7.7 B versus FCC-ee 10.5 B. The AC power (267 MW) to operate the ILC luminosity upgrade will also be less than the AC power for FCC-ee (300 MW). Even with a modest quality factor Q of $1 \times 10^{10}$ for SRF cavities, the total cost of the upgrade will be 2.5 B ILCU additional over ILC250 baseline. We expect that, if approved, ILC250 will first be built at the baseline luminosity, operated for many years at this luminosity, and later upgraded to the high luminosity option. A significant part (RF power and cryo-power) of the additional cost for the luminosity upgrade overlaps with the expected additional costs for anticipated energy upgrade paths. A second ILC upgrade discussed in this paper will be to the higher energy Top Factory at 380 GeV. We also estimate the additional cost of this upgrade (1.5 B ILCU).


title: Escaping Saddle Points for Zeroth-order Nonconvex Optimization using Estimated Gradient Descent

abstract: Gradient descent and its variants are widely used in machine learning. However, oracle access of gradient may not be available in many applications, limiting the direct use of gradient descent. This paper proposes a method of estimating gradient to perform gradient descent, that converges to a stationary point for general non-convex optimization problems. Beyond the first-order stationary properties, the second-order stationary properties are important in machine learning applications to achieve better performance. We show that the proposed model-free non-convex optimization algorithm returns an $\epsilon$-second-order stationary point with $\widetilde{O}(\frac{d^{2+\frac{\theta}{2}}}{\epsilon^{8+\theta}})$ queries of the function for any arbitrary $\theta>0$.


title: Counting locally flat-foldable origami configurations via 3-coloring graphs

abstract: Origami, where two-dimensional sheets are folded into complex structures, is proving to be rich with combinatorial and geometric structure, most of which remains to be fully understood. In this paper we consider \emph{flat origami}, where the sheet of material is folded into a two-dimensional object, and consider the mountain (convex) and valley (concave) creases made by such foldings, called a \emph{MV assignment} of the crease pattern. We establish a method to, given a flat-foldable crease pattern $C$ under certain conditions, create a planar graph $C^*$ whose 3-colorings are in one-to-one correspondence with the locally-valid MV assignments of $C$. This reduces the general, unsolved problem of enumerating locally-valid MV assignments to the enumeration of 3-colorings of graphs.


title: Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks

abstract: Recently, increasing attention has been drawn to the internal mechanisms of convolutional neural networks, and the reason why the network makes specific decisions. In this paper, we develop a novel post-hoc visual explanation method called Score-CAM based on class activation mapping. Unlike previous class activation mapping based approaches, Score-CAM gets rid of the dependence on gradients by obtaining the weight of each activation map through its forward passing score on target class, the final result is obtained by a linear combination of weights and activation maps. We demonstrate that Score-CAM achieves better visual performance and fairness for interpreting the decision making process. Our approach outperforms previous methods on both recognition and localization tasks, it also passes the sanity check. We also indicate its application as debugging tools. Official code has been released.


title: A Hybrid Cooperative Co-evolution Algorithm Framework for Optimising Power Take Off and Placements of Wave Energy Converters

abstract: Wave energy technologies have the potential to play a significant role in the supply of renewable energy on a world scale. One of the most promising designs for wave energy converters (WECs) are fully submerged buoys. In this work, we explore the optimisation of WEC arrays consisting of a three-tether buoy model called CETO. Such arrays can be optimised for total energy output by adjusting both the relative positions of buoys in farms and also the power-take-off (PTO) parameters for each buoy. The search space for these parameters is complex and multi-modal. Moreover, the evaluation of each parameter setting is computationally expensive -- limiting the number of full model evaluations that can be made. To handle this problem, we propose a new hybrid cooperative co-evolution algorithm (HCCA). HCCA consists of a symmetric local search plus Nelder-Mead and a cooperative co-evolution algorithm (CC) with a backtracking strategy for optimising the positions and PTO settings of WECs, respectively. Moreover, a new adaptive scenario is proposed for tuning grey wolf optimiser (AGWO) hyper-parameter. AGWO participates notably with other applied optimisers in HCCA. For assessing the effectiveness of the proposed approach five popular Evolutionary Algorithms (EAs), four alternating optimisation methods and two modern hybrid ideas (LS-NM and SLS-NM-B) are carefully compared in four real wave situations (Adelaide, Tasmania, Sydney and Perth) with two wave farm sizes (4 and 16). According to the experimental outcomes, the hybrid cooperative framework exhibits better performance in terms of both runtime and quality of obtained solutions.


title: On a rainbow version of Dirac's theorem

abstract: For a collection $\mathbf{G}=\{G_1,\dots, G_s\}$ of not necessarily distinct graphs on the same vertex set $V$, a graph $H$ with vertices in $V$ is a $\mathbf{G}$-transversal if there exists a bijection $\phi:E(H)\rightarrow [s]$ such that $e\in E(G_{\phi(e)})$ for all $e\in E(H)$. We prove that for $|V|=s\geq 3$ and $\delta(G_i)\geq s/2$ for each $i\in [s]$, there exists a $\mathbf{G}$-transversal that is a Hamilton cycle. This confirms a conjecture of Aharoni. We also prove an analogous result for perfect matchings.


title: The Triangle Operator

abstract: We examine the averaging operator $T$ corresponding to the manifold in $\mathbb{R}^{2d}$ of pairs of points $(u,v)$ satisfying $|u| = |v| = |u - v| = 1$, so that $\{0,u,v\}$ is the set of vertices of an equilateral triangle. We establish $L^p \times L^q \rightarrow L^r$ boundedness for $T$ for $(1/p, 1/q, 1/r)$ in the convex hull of the set of points $\lbrace (0, 0, 0) ,\, (1, 0 , 1) ,\, (0, 1, 1) , \, ({1}/{p_d}, {1}/{p_d}, {2}/{p_d}) \rbrace$, where $p_d = \frac{19d-4}{11d - 12}$ and $d\geq 7$.


title: Improved Boltzmann machines with error corrected quantum annealing

abstract: Boltzmann machines are the basis of several deep learning methods that have been successfully applied to both supervised and unsupervised machine learning tasks. These models assume that a dataset is generated according to a Boltzmann distribution, and the goal of the training procedure is to learn the set of parameters that most closely match the input data distribution. Training such models is difficult due to the intractability of traditional sampling techniques, and proposals using quantum annealers for sampling hope to mitigate the sampling cost. However, real physical devices will inevitably be coupled to the environment, and the strength of this coupling affects the effective temperature of the distributions from which a quantum annealer samples. To counteract this problem, error correction schemes that can effectively reduce the temperature are needed if there is to be some benefit in using quantum annealing for problems at a larger scale, where we might expect the effective temperature of the device to not be sufficiently low. To this end, we have applied nested quantum annealing correction (NQAC) to do unsupervised learning with a small bars and stripes dataset, and to do supervised learning with a coarse-grained MNIST dataset. For both datasets we demonstrate improved training and a concomitant effective temperature reduction at higher noise levels relative to the unencoded case. We also find better performance overall with longer anneal times and offer an interpretation of the results based on a comparison to simulated quantum annealing and spin vector Monte Carlo. A counterintuitive aspect of our results is that the output distribution generally becomes less Gibbs-like with increasing nesting level and increasing anneal times, which shows that improved training performance can be achieved without equilibration to the target Gibbs distribution.


title: Microscopic Theory of the Influence of Strong Attractive Forces on the Activated Dynamics of Dense Glass and Gel Forming Fluids

abstract: We theoretically study the non-monotonic (re-entrant) activated dynamics associated with a repulsive glass to fluid to attractive glass transition in high density particle suspensions interacting via strong short range attractive forces. The classic theoretical projection approximation that replaces all microscopic forces by a single effective force determined solely by equilibrium pair correlations is revisited based on the projectionless dynamic theory (PDT) that avoids force projection. A hybrid-PDT is formulated that explicitly quantifies how attractive forces induce dynamical constraints, while singular hard core interactions are treated based on the projection approach. Both the effects of interference between repulsive and attractive forces, and structural changes due to attraction-induced bond formation that competes with caging, are included. Combined with the microscopic Elastically Collective Nonlinear Langevin Equation (ECNLE) theory of activated relaxation, the resultant approach appears to properly capture both the re-entrant dynamic crossover behavior and the strong non-monotonic variation of the activated structural relaxation time with attraction strength and range at very high volume fractions. Qualitative differences with ECNLE theory-based results that adopt the full projection approximation are identified, and testable predictions made. The new formulation appears qualitatively consistent with multiple experimental and simulation studies, and provides a new perspective for the overall problem that is rooted in activated motion and interference between repulsive and attractive forces. This is conceptually distinct from empirical shifting or other ad hoc modifications of ideal mode coupling theory which do not take into account activated dynamics. Implications for thermal glass forming liquids are briefly discussed.


title: Updated Constraints on Asteroid-Mass Primordial Black Holes as Dark Matter

abstract: Microlensing of stars places significant constraints on sub-planetary-mass compact objects, including primordial black holes, as dark matter candidates. As the lens' Einstein radius in the source plane becomes comparable to the size of the light source, however, source amplification is strongly suppressed, making it challenging to constrain lenses with a mass at or below $10^{-10}$ solar masses, i.e. asteroid-mass objects. Current constraints, using Subaru HSC observations of M31, assume a fixed source size of one solar radius. Here we point out that the actual stars in M31 bright enough to be used for microlensing are typically much larger. We correct the HSC constraints by constructing a source size distribution based on the M31 PHAT survey and on a synthetic stellar catalogue, and by correspondingly weighing the finite-size source effects. We find that the actual HSC constraints are weaker by up to almost three orders of magnitude in some cases, broadening the range of masses for which primordial black holes can be the totality of the cosmological dark matter by almost one order of magnitude.


title: Learning Temporal Action Proposals With Fewer Labels

abstract: Temporal action proposals are a common module in action detection pipelines today. Most current methods for training action proposal modules rely on fully supervised approaches that require large amounts of annotated temporal action intervals in long video sequences. The large cost and effort in annotation that this entails motivate us to study the problem of training proposal modules with less supervision. In this work, we propose a semi-supervised learning algorithm specifically designed for training temporal action proposal networks. When only a small number of labels are available, our semi-supervised method generates significantly better proposals than the fully-supervised counterpart and other strong semi-supervised baselines. We validate our method on two challenging action detection video datasets, ActivityNet v1.3 and THUMOS14. We show that our semi-supervised approach consistently matches or outperforms the fully supervised state-of-the-art approaches.


title: Exoskeleton-covered soft finger with vision-based proprioception and tactile sensing

abstract: Soft robots offer significant advantages in adaptability, safety, and dexterity compared to conventional rigid-body robots. However, it is challenging to equip soft robots with accurate proprioception and tactile sensing due to their high flexibility and elasticity. In this work, we describe the development of a vision-based proprioceptive and tactile sensor for soft robots called GelFlex, which is inspired by previous GelSight sensing techniques. More specifically, we develop a novel exoskeleton-covered soft finger with embedded cameras and deep learning methods that enable high-resolution proprioceptive sensing and rich tactile sensing. To do so, we design features along the axial direction of the finger, which enable high-resolution proprioceptive sensing, and incorporate a reflective ink coating on the surface of the finger to enable rich tactile sensing. We design a highly underactuated exoskeleton with a tendon-driven mechanism to actuate the finger. Finally, we assemble 2 of the fingers together to form a robotic gripper and successfully perform a bar stock classification task, which requires both shape and tactile information. We train neural networks for proprioception and shape (box versus cylinder) classification using data from the embedded sensors. The proprioception CNN had over 99\% accuracy on our testing set (all six joint angles were within 1 degree of error) and had an average accumulative distance error of 0.77 mm during live testing, which is better than human finger proprioception. These proposed techniques offer soft robots the high-level ability to simultaneously perceive their proprioceptive state and peripheral environment, providing potential solutions for soft robots to solve everyday manipulation tasks. We believe the methods developed in this work can be widely applied to different designs and applications.


title: Towards Efficient Local Causal Structure Learning

abstract: Local causal structure learning aims to discover and distinguish direct causes (parents) and direct effects (children) of a variable of interest from data. While emerging successes have been made, existing methods need to search a large space to distinguish direct causes from direct effects of a target variable \emph{T}. To tackle this issue, we propose a novel Efficient Local Causal Structure learning algorithm, named ELCS. Specifically, we first propose the concept of N-structures, then design an efficient Markov Blanket (MB) discovery subroutine to integrate MB learning with N-structures to learn the MB of \emph{T} and simultaneously distinguish direct causes from direct effects of \emph{T}. With the proposed MB subroutine, ELCS starts from the target variable, sequentially finds MBs of variables connected to the target variable and simultaneously constructs local causal structures over MBs until the direct causes and direct effects of the target variable have been distinguished. Using eight Bayesian networks the extensive experiments have validated that ELCS achieves better accuracy and efficiency than the state-of-the-art algorithms.


title: Neural Zero-Inflated Quality Estimation Model For Automatic Speech Recognition System

abstract: The performances of automatic speech recognition (ASR) systems are usually evaluated by the metric word error rate (WER) when the manually transcribed data are provided, which are, however, expensively available in the real scenario. In addition, the empirical distribution of WER for most ASR systems usually tends to put a significant mass near zero, making it difficult to simulate with a single continuous distribution. In order to address the two issues of ASR quality estimation (QE), we propose a novel neural zero-inflated model to predict the WER of the ASR result without transcripts. We design a neural zero-inflated beta regression on top of a bidirectional transformer language model conditional on speech features (speech-BERT). We adopt the pre-training strategy of token level mask language modeling for speech-BERT as well, and further fine-tune with our zero-inflated layer for the mixture of discrete and continuous outputs. The experimental results show that our approach achieves better performance on WER prediction in the metrics of Pearson and MAE, compared with most existed quality estimation algorithms for ASR or machine translation.


title: Mobile Phone Use as Sequential Processes: From Discrete Behaviors to Sessions of Behaviors and Trajectories of Sessions

abstract: Mobile phone use is an unfolding process by nature. In this study, it is explicated as two sequential processes: mobile sessions composed of an uninterrupted set of behaviors and mobile trajectories composed of mobile sessions and mobile-off time. A dataset of a five-month behavioral logfile of mobile application use by approximately 2,500 users in Hong Kong is used. Mobile sessions are constructed and mined to uncover sequential characteristics and patterns in mobile phone use. Mobile trajectories are analyzed to examine intraindividual change and interindividual differences on mobile re-engagement as indicators of behavioral dynamics in mobile phone use. The study provides empirical support for and expands the boundaries of existing theories about combinatorial use of information and communication technologies (ICTs). Finally, the understanding on mobile temporality is enhanced, that is, mobile temporality is homogeneous across social sectors. Furthermore, mobile phones redefine, rather than blur, the boundary between private and public time.


title: The motivic zeta functions of a matroid

abstract: We introduce motivic zeta functions for matroids. These zeta functions are defined as sums over the lattice points of Bergman fans, and in the realizable case, they coincide with the motivic Igusa zeta functions of hyperplane arrangements. We show that these motivic zeta functions satisfy a functional equation arising from matroid Poincar\'{e} duality in the sense of Adiprasito-Huh-Katz. In the process, we obtain a formula for the Hilbert series of the cohomology ring of a matroid, in the sense of Feichtner-Yuzvinsky. We then show that our motivic zeta functions specialize to the topological zeta functions for matroids introduced by van der Veer, and we compute the first two coefficients in the Taylor expansion of these topological zeta functions, providing affirmative answers to two questions posed by van der Veer.


title: Regularized Ensemble Kalman Methods for Inverse Problems

abstract: Inverse problems are common and important in many applications in computational physics but are inherently ill-posed with many possible model parameters resulting in satisfactory results in the observation space. When solving the inverse problem with adjoint-based optimization, the problem can be regularized by adding additional constraints in the cost function. However, similar regularizations have not been used in ensemble-based methods, where the same optimization is done implicitly through the analysis step rather than through explicit minimization of the cost function. Ensemble-based methods, and in particular ensemble Kalman methods, have gained popularity in practice where physics models typically do not have readily available adjoint capabilities. While the model outputs can be improved by incorporating observations using these methods, the lack of regularization means the inference of the model parameters remains ill-posed. Here we propose a regularized ensemble Kalman method capable of enforcing regularization constraints. Specifically, we derive a modified analysis scheme that implicitly minimizes a cost function with generalized constraints. We demonstrate the method's ability to regularize the inverse problem with three cases of increasing complexity, starting with inferring scalar model parameters. As a final case, we utilize the proposed method to infer the closure field in the Reynolds-averaged Navier--Stokes equations; a problem of significant importance in fluid dynamics and many engineering applications.


title: A Fast Exponential Time Algorithm for Max Hamming Distance X3SAT

abstract: X3SAT is the problem of whether one can satisfy a given set of clauses with up to three literals such that in every clause, exactly one literal is true and the others are false. A related question is to determine the maximal Hamming distance between two solutions of the instance. Dahll\"of provided an algorithm for Maximum Hamming Distance XSAT, which is more complicated than the same problem for X3SAT, with a runtime of $O(1.8348^n)$; Fu, Zhou and Yin considered Maximum Hamming Distance for X3SAT and found for this problem an algorithm with runtime $O(1.6760^n)$. In this paper, we propose an algorithm in $O(1.3298^n)$ time to solve the Max Hamming Distance X3SAT problem; the algorithm actually counts for each $k$ the number of pairs of solutions which have Hamming Distance $k$.


title: On the Spectral and Energy Efficiencies of Full-Duplex Cell-Free Massive MIMO

abstract: In-band full-duplex (FD) operation is practically more suited for short-range communications such as WiFi and small-cell networks, due to its current practical limitations on the self-interference cancellation. In addition, cell-free massive multiple-input multiple-output (CF-mMIMO) is a new and scalable version of MIMO networks, which is designed to bring service antennas closer to end user equipments (UEs). To achieve higher spectral and energy efficiencies (SE-EE) of a wireless network, it is of practical interest to incorporate FD capability into CF-mMIMO systems to utilize their combined benefits. We formulate a novel and comprehensive optimization problem for the maximization of SE and EE in which power control, access point-UE (AP-UE) association and AP selection are jointly optimized under a realistic power consumption model, resulting in a difficult class of mixed-integer nonconvex programming. To tackle the binary nature of the formulated problem, we propose an efficient approach by exploiting a strong coupling between binary and continuous variables, leading to a more tractable problem. In this regard, two low-complexity transmission designs based on zero-forcing (ZF) are proposed. Combining tools from inner approximation framework and Dinkelbach method, we develop simple iterative algorithms with polynomial computational complexity in each iteration and strong theoretical performance guaranteed. Furthermore, towards a robust design for FD CF-mMIMO, a novel heap-based pilot assignment algorithm is proposed to mitigate effects of pilot contamination. Numerical results show that our proposed designs with realistic parameters significantly outperform the well-known approaches (i.e., small-cell and collocated mMIMO) in terms of the SE and EE. Notably, the proposed ZF designs require much less execution time than the simple maximum ratio transmission/combining.


title: Nonlinear transport of ballistic Dirac electrons tunneling through a tunable potential barrier in graphene

abstract: Dirac-electronic tunneling and nonlinear transport properties with both finite and zero energy bandgap are investigated for graphene with a tilted potential barrier under a bias. For validation, results from a finite-difference based numerical approach, which is developed for calculating transmission and reflection coefficients with a dynamically-tunable (time-dependent bias field) barrier-potential profile, are compared with those of both an analytical model for a static square-potential barrier and a perturbation theory using Wentzel-Kramers-Brillouin (WKB) approximation. For a biased barrier, both transmission coefficient and tunneling resistance are computed and analyzed, indicating a full control of the peak in tunneling resistance by bias field for a tilted barrier, gate voltage for barrier height, and energy for incoming electrons. Moreover, a finite energy gap in graphene is found to suppress head-on transmission as well as skew transmission with a large transverse momentum. For a gapless graphene, on the other hand, filtering of Dirac electrons outside of normal incidence is found and can be used for designing electronic lenses. All these predicted attractive transport properties are expected extremely useful for the development of novel electronic and optical graphene-based devices.


title: Best-first Search Algorithm for Non-convex Sparse Minimization

abstract: Non-convex sparse minimization (NSM), or $\ell_0$-constrained minimization of convex loss functions, is an important optimization problem that has many machine learning applications. NSM is generally NP-hard, and so to exactly solve NSM is almost impossible in polynomial time. As regards the case of quadratic objective functions, exact algorithms based on quadratic mixed-integer programming (MIP) have been studied, but no existing exact methods can handle more general objective functions including Huber and logistic losses; this is unfortunate since those functions are prevalent in practice. In this paper, we consider NSM with $\ell_2$-regularized convex objective functions and develop an algorithm by leveraging the efficiency of best-first search (BFS). Our BFS can compute solutions with objective errors at most $\Delta\ge0$, where $\Delta$ is a controllable hyper-parameter that balances the trade-off between the guarantee of objective errors and computation cost. Experiments demonstrate that our BFS is useful for solving moderate-size NSM instances with non-quadratic objectives and that BFS is also faster than the MIP-based method when applied to quadratic objectives.


title: Evolutionary dimension reduction in phenotypic space

abstract: In general, cellular phenotypes, as measured by concentrations of cellular components, involve large degrees of freedom. However, recent measurement has demonstrated that phenotypic changes resulting from adaptation and evolution in response to environmental changes are effectively restricted to a low-dimensional subspace. Thus, uncovering the origin and nature of such a drastic dimension reduction is crucial to understanding the general characteristics of biological adaptation and evolution. Herein, we first formulated the dimension reduction in terms of dynamical systems theory: considering the steady growth state of cells, the reduction is represented by the separation of a few large singular values of the inverse Jacobian matrix around a fixed point. We then examined this dimension reduction by numerical evolution of cells consisting of thousands of chemicals whose concentrations determine phenotype. As a result of the evolution, phenotypic changes due to mutations and external perturbations were found to be mainly restricted to a one-dimensional subspace. One singular value of the inverse Jacobian matrix at a fixed point of concentrations was significantly larger than the others. The major phenotypic changes due to mutations and external perturbations occur along the corresponding left-singular vector, which leads to phenotypic constraint, and fitness dominantly changes in the same direction. Once such phenotypic constraint is acquired, phenotypic evolution to a novel environment takes advantage of this restricted phenotypic direction. This results in the convergence of phenotypic pathways across genetically different strains, as is experimentally observed, while accelerating further evolution.


title: Dynamics of transient cat-states in degenerate parametric oscillation with and without nonlinear Kerr interactions

abstract: A cat-state is formed as the steady-state solution for the signal mode of an ideal, degenerate parametric oscillator, in the limit of negligible single-photon signal loss. In the presence of the signal loss, this is no longer true over timescales much longer than the damping time. However, for sufficient parametric nonlinearity, a cat-state can exist as a transient state. In this paper, we study the dynamics of the creation and decoherence of cat-states in degenerate parametric oscillation, both with and without the effect of a Kerr nonlinearity that applies to recent superconducting-circuit experiments generating cat-states in microwave cavities. We determine the time of formation and the lifetime of a cat-state in terms of three dimensionless parameters $\lambda$, $g$ and $\chi$. These relate to the driving strength, the parametric nonlinearity, and the Kerr nonlinearity, respectively. We find that the Kerr nonlinearity has little effect on the threshold parametric nonlinearity ($g>1$) required for the formation of cat-states, and does not significantly alter the decoherence time of the cat-state, but can reduce the time of formation. The quality of the cat-state increases with the value $g$, and can also improved by the Kerr nonlinearity. To verify the existence and quality of the cat-state, we consider several signatures, including interference fringes and negativity, and show how they can be computed. We simulate a superconducting-circuit experiment using published experimental parameters and found good agreement with experimental results, indicating that a nonclassical cat-like state with a small Wigner negativity is generated in the experiment. A stronger nonlinearity would lead to a cat-state with convincing cat-state signatures. Finally, we explore the feasibility of creating large cat-states with a coherent amplitude of 20, corresponding to 400 photons.


title: Hitachi at MRP 2019: Unified Encoder-to-Biaffine Network for Cross-Framework Meaning Representation Parsing

abstract: This paper describes the proposed system of the Hitachi team for the Cross-Framework Meaning Representation Parsing (MRP 2019) shared task. In this shared task, the participating systems were asked to predict nodes, edges and their attributes for five frameworks, each with different order of "abstraction" from input tokens. We proposed a unified encoder-to-biaffine network for all five frameworks, which effectively incorporates a shared encoder to extract rich input features, decoder networks to generate anchorless nodes in UCCA and AMR, and biaffine networks to predict edges. Our system was ranked fifth with the macro-averaged MRP F1 score of 0.7604, and outperformed the baseline unified transition-based MRP. Furthermore, post-evaluation experiments showed that we can boost the performance of the proposed system by incorporating multi-task learning, whereas the baseline could not. These imply efficacy of incorporating the biaffine network to the shared architecture for MRP and that learning heterogeneous meaning representations at once can boost the system performance.


title: Resilience in multi-robot target tracking through reconfiguration

abstract: We address the problem of maintaining resource availability in a networked multi-robot system performing distributed target tracking. In our model, robots are equipped with sensing and computational resources enabling them to track a target's position using a Distributed Kalman Filter (DKF). We use the trace of each robot's sensor measurement noise covariance matrix as a measure of sensing quality. When a robot's sensing quality deteriorates, the system's communication graph is modified by adding edges such that the robot with deteriorating sensor quality may share information with other robots to improve the team's target tracking ability. This computation is performed centrally and is designed to work without a large change in the number of active communication links. We propose two mixed integer semi-definite programming formulations (an 'agent-centric' strategy and a 'team-centric' strategy) to achieve this goal. We implement both formulations and a greedy strategy in simulation and show that the team-centric strategy outperforms the agent-centric and greedy strategies.


title: About Three Dimensional Jump Boundary Value Problems for the Laplacian

abstract: The conditions of well-posed solvability of searched function and its normal derivative three dimensional jump problem for the Laplacian and equivalent to them integral equation system for the sum of the simple and double layer potentials are determined in the Hilbert space, element of which as well as their normal derivatives have the jump through boundary surface.


title: Data-Efficient Goal-Oriented Conversation with Dialogue Knowledge Transfer Networks

abstract: Goal-oriented dialogue systems are now being widely adopted in industry where it is of key importance to maintain a rapid prototyping cycle for new products and domains. Data-driven dialogue system development has to be adapted to meet this requirement --- therefore, reducing the amount of data and annotations necessary for training such systems is a central research problem. In this paper, we present the Dialogue Knowledge Transfer Network (DiKTNet), a state-of-the-art approach to goal-oriented dialogue generation which only uses a few example dialogues (i.e. few-shot learning), none of which has to be annotated. We achieve this by performing a 2-stage training. Firstly, we perform unsupervised dialogue representation pre-training on a large source of goal-oriented dialogues in multiple domains, the MetaLWOz corpus. Secondly, at the transfer stage, we train DiKTNet using this representation together with 2 other textual knowledge sources with different levels of generality: ELMo encoder and the main dataset's source domains. Our main dataset is the Stanford Multi-Domain dialogue corpus. We evaluate our model on it in terms of BLEU and Entity F1 scores, and show that our approach significantly and consistently improves upon a series of baseline models as well as over the previous state-of-the-art dialogue generation model, ZSDG. The improvement upon the latter --- up to 10% in Entity F1 and the average of 3% in BLEU score --- is achieved using only the equivalent of 10% of ZSDG's in-domain training data.


title: From Senseless Swarms to Smart Mobs: Tuning Networks for Prosocial Behaviour

abstract: Social media have been seen to accelerate the spread of negative content such as disinformation and hate speech, often unleashing reckless herd mentality within networks, further aggravated by malicious entities using bots for amplification. So far, the response to this emerging global crisis has centred around social media platform companies making reactive moves that appear to have greater symbolic value than practical utility. These include taking down patently objectionable content or manually deactivating the accounts of bad actors, while leaving vast troves of negative content to circulate and perpetuate within social networks. Governments worldwide have thus sought to intervene using regulatory tools, with countries such as France, Germany and Singapore introducing laws to compel technology companies to take down or correct erroneous and harmful content. However, the relentless pace of technological progress enfeebles regulatory measures that seem fated for obsolescence.


title: Hash-Based Ray Path Prediction: Skipping BVH Traversal Computation by Exploiting Ray Locality

abstract: State-of-the-art ray tracing techniques operate on hierarchical acceleration structures such as BVH trees which wrap objects in a scene into bounding volumes of decreasing sizes. Acceleration structures reduce the amount of ray-scene intersections that a ray has to perform to find the intersecting object. However, we observe a large amount of redundancy when rays are traversing these acceleration structures. While modern acceleration structures explore the spatial organization of the scene, they neglect similarities between rays that traverse the structures and thereby cause redundant traversals. This paper provides a limit study of a new promising technique, Hash-Based Ray Path Prediction (HRPP), which exploits the similarity between rays to predict leaf nodes to avoid redundant acceleration structure traversals. Our data shows that acceleration structure traversal consumes a significant proportion of the ray tracing rendering time regardless of the platform or the target image quality. Our study quantifies unused ray locality and evaluates the theoretical potential for improved ray traversal performance for both coherent and seemingly incoherent rays. We show that HRPP is able to skip, on average, 40% of all hit-all traversal computations.