title: Stop Building Castles on a Swamp! The Crisis of Reproducing Automatic Search in Evidence-based Software Engineering

abstract: The evidence-based approach has increasingly been employed to synthesize empirical findings from the primary research in software engineering. Nevertheless, the reproducibility of evidence-based software engineering (EBSE) studies seems to be underemphasized. In our investigation into the automatic search of 311 sample studies, more than 50% of the search strings are not reusable; about 87.5% of the search activities (e.g., search field settings) are unrepeatable; and more than 95% of the whole automatic search implementations are unreproducible. Considering that searching is a cornerstone of an EBSE study, we are afraid that the reproducibility of the current secondary research could be worse than we can imagine. By analyzing and reporting the root causes of the aforementioned observations, we urge collaboration and cooperation among all the stakeholders in our community to improve the research reproducibility in EBSE.


title: Chiral Edge Modes in Helmholtz-Onsager Vortex Systems

abstract: Vortices play a fundamental role in the physics of two-dimensional (2D) fluids across a range of length scales, from quantum superfluids to geophysical flows. Despite a history dating back to Helmholtz, point vortices in a 2D fluid continue to pose interesting theoretical problems, owing to their unusual statistical mechanics. Here, we show that the strongly interacting Helmholtz-Onsager vortex systems can form statistical edge modes at low energies, extending a previously identified analogy between vortex matter and quantum Hall systems. Through dynamical simulations, Monte-Carlo sampling and mean-field theory, we demonstrate that these edge modes are associated with the formation of dipoles of real and image vortices at boundaries. The edge modes are robust, persisting in nonconvex domains, and are in quantitative agreement with the mean-field predictions.


title: Categorical enumerative invariants of the ground field

abstract: For an $S^1$-framed modular operad $P$, we introduce its "Feynman compactification" denoted by $FP$ which is a modular operad. Let $\{\mathbb{M}^{\sf fr}(g,n)\}_{(g,n)}$ be the $S^1$-framed modular operad defined using moduli spaces of smooth curves with framings along punctures. We prove that the homology operad of $F\mathbb{M}^{\sf fr}$ is isomorphic to $H_*(\overline{M})$, the homology operad of the Deligne-Mumford operad. Using this isomorphism, we obtain an explicit formula of the fundamental class of $[\overline{M}_{g,n}/S_n]$ in terms of Sen-Zwiebach's string vertices. As an immediate application, under mild assumptions, we prove that Costello's categorical enumerative invariants of the ground field match with the Gromov-Witten invariants of a point.


title: Extrusion of chromatin loops by a composite loop extrusion factor

abstract: Chromatin loop extrusion by Structural Maintenance of Chromosome (SMC) complexes is thought to underlie intermediate-scale chromatin organization inside cells. Motivated by a number of experiments suggesting that nucleosomes may block loop extrusion by SMCs, such as cohesin and condensin complexes, we introduce and characterize theoretically a composite loop extrusion factor (composite LEF) model. In addition to an SMC complex that creates a chromatin loop by encircling two threads of DNA, this model includes a remodeling complex that relocates or removes nucleosomes as it progresses along the chromatin, and nucleosomes that block SMC translocation along the DNA. Loop extrusion is enabled by SMC motion along nucleosome-free DNA, created in the wake of the remodeling complex, while nucleosome re-binding behind the SMC acts as a ratchet, holding the SMC close to the remodeling complex. We show that, for a wide range of parameter values, this collection of factors constitutes a composite LEF that extrudes loops with a velocity, comparable to the velocity of remodeling complex translocation on chromatin in the absence of SMC, and much faster than loop extrusion by an isolated SMC that is blocked by nucleosomes.


title: Atomistic insights into hydrogen bonds of water around detonation nanodiamonds: effects of surface chemistry and dissolved ions

abstract: Prior studies on the effects of surface chemistry of detonation nanodiamonds (DNDs) on Hydrogen Bonds (HBs) of water have not unambiguously distinguished among three broad categories of HBs: water-site HBs (HB$^{(s)}$), water-water HBs in hydration layers of DNDs (HB$^{(h)}$), and water-water HBs in the bulk region (HB$^{(b)}$). Furthermore, the effects of dissolved ions in the solution on the aforementioned HBs have not been studied yet. In this study, we addressed these issues via Molecular Dynamics simulations. Each system under study contained a single DND that was functionalized either with purely -H or with a mixture of -H and one of -NH$_2$, -COOH, or -OH groups. Then, the product was dissolved in 0.1M aqueous solution of any of KCl, NaCl, CaCl$_2$, or MgCl$_2$ salts. All DNDs except for DND-OH, which was charge neutral, existed as either a charged or a neutral particle in the solution. Whereas DND-H with +56 net charges induced the strongest HB$^{(h)}$, the addition of +28 charges to DND-H led to a drop in HB$^{(h)}$ strength and became identical to what we observed for HB$^{(h)}$ strength around DND-OH. Considering only neutral DNDs, HB$^{(h)}$ strength increased in the sequence as DND-H $\approx$ DND-COOH < DND-OH < DND-NH$_2$. For the case of the negatively charged DND-COOH, while HB$^{(h)}$ in either NaCl or KCl solution was slightly weaker than HB$^{(b)}$, HB$^{(h)}$ strength corresponding to CaCl$_2$ or MgCl$_2$ solutions were enhanced compared to HB$^{(b)}$. Interestingly, Mg$^{2+}$ and to a lesser extent Ca$^{2+}$ around the charged DND-COOH were associated with the strongest HB$^{(s)}$in this study.


title: Robust stimulated Raman shortcut-to-adiabatic passage by invariant-based optimal control

abstract: The stimulated Raman adiabatic passage (STIRAP) shows an efficient technique that accurately transfers population between two discrete quantum states with the same parity, in three-level quantum systems based on adiabatic evolution. This technique has widely theoretical and experimental applications in many fields of physics, chemistry, and beyond. Here, we present a generally robust approach to speed up STIRAP with invariant-based shortcut to adiabaticity. By controlling the dynamical process, we inversely design a family of Hamiltonians that can realize fast and accurate population transfer from the first to the third level, while the systematic error is largely suppressed in general. Furthermore, a detailed trade-off relation between the population of the intermediate state and the amplitudes of Rabi frequencies in the transfer process is illustrated. These results provide an optimal route toward manipulating the evolution of three-level quantum systems in future quantum information processing.


title: On a Factorial Knowledge Architecture for Data Science-powered Software Engineering

abstract: Given the data-intensive and collaborative trend in science, the software engineering community also pays increasing attention to obtaining valuable and useful insights from data repositories. Nevertheless, applying data science to software engineering (e.g., mining software repositories) can be blindfold and meaningless, if lacking a suitable knowledge architecture (KA). By observing that software engineering practices are generally recorded through a set of factors (e.g., programmer capacity, different environmental conditions, etc.) involved in various software project aspects, we propose a factor-based hierarchical KA of software engineering to help maximize the value of software repositories and inspire future software data-driven studies. In particular, it is the organized factors and their relationships that help guide software engineering knowledge mining, while the mined knowledge will in turn be indexed/managed through the relevant factors and their interactions. This paper explains our idea about the factorial KA and concisely demonstrates a KA component, i.e. the early-version KA of software product engineering. Once fully scoped, this proposed KA will supplement the well-known SWEBOK in terms of both the factor-centric knowledge management and the coverage/implication of potential software engineering knowledge.


title: The Biermann battery driven by a streaming plasma

abstract: The Biermann battery is a promising generation mechanism of a seed magnetic field in the universe. We propose a new driving mechanism for the Biermann battery in an inhomogeneous plasma with a beam component. An inhomogeneous electron flow induced by the return current can make an electron pressure gradient which is not parallel to the density gradient. As a result, the magnetic field is generated by the Biermann battery. We demonstrate the new generation mechanism of the magnetic field by conducting three-fluid plasma simulations. By this mechanism, the first cosmic rays can generate the seed magnetic field with astrophysical scales at redshift around 20.


title: Scalarization of slowly rotating black holes

abstract: It is interesting to note that most black holes are born very slowly rotating. We investigate scalarization of slowly rotating black holes in the Einstein-scalar-Chern-Simons (EsCS) theory. In the slow rotation approximation, the CS term takes a linear form of rotation parameter $a$ which determines the tachyonic instability. The tachyonic instability for slowly rotating black holes represents the onset of spontaneous scalarization. It is shown that the slowly rotating black holes are unstable against a spherically symmetric scalar-mode perturbation for positive coupling $\alpha$, whereas these black holes are unstable for negative coupling without any $a$-bound.


title: On the law of the iterated logarithm under the sub-linear expectations

abstract: In this paper, we establish some general forms of the law of the iterated logarithm for independent random variables in a sub-linear expectation space, where the random variables are not necessarily identically distributed. Exponential inequalities for the maximum sum of independent random variables and Kolmogorov's converse exponential inequalities are established as tools for showing the law of the iterated logarithm. As an application, the sufficient and necessary conditions of the law of iterated logarithm for independent and identically distributed random variables under the sub-linear expectation are obtained.


title: Sample Complexity and Overparameterization Bounds for Temporal Difference Learning with Neural Network Approximation

abstract: In this paper, we study the dynamics of temporal difference learning with neural network-based value function approximation over a general state space, namely, \emph{Neural TD learning}. We consider two practically used algorithms, projection-free and max-norm regularized Neural TD learning, and establish the first convergence bounds for these algorithms. An interesting observation from our results is that max-norm regularization can dramatically improve the performance of TD learning algorithms, both in terms of sample complexity and overparameterization. In particular, we prove that max-norm regularization improves state-of-the-art sample complexity and overparameterization bounds. The results in this work rely on a novel Lyapunov drift analysis of the network parameters as a stopped and controlled random process.


title: Complexes, residues and obstructions for log-symplectic manifolds

abstract: We consider compact K\"ahlerian manifolds $X$ of even dimension 4 or more, endowed with a log-symplectic structure $\Phi$, a generically nondegenerate closed 2-form with simple poles on a divisor $D$ with local normal crossings. A simple linear inequality involving the iterated Poincar\'e residues of $\Phi$ at components of the double locus of $D$ ensures that the pair $(X, \Phi)$ has unobstructed deformations and that $D$ deforms locally trivially.


title: Exact meromorphic solutions of Schwarzian differential equations

abstract: This paper studies exact meromorphic solutions of the autonomous Schwarzian differential equations. All transcendental meromorphic solutions of five canonical types (among six) of the autonomous Schwarzian differential equations are constructed explicitly. In particular, the solutions of four types are shown to be elliptic functions. Also, all transcendental meromorphic solutions that are locally injective or possess a Picard exceptional value are characterized for the remaining canonical type.


title: Object Allocation Over a Network of Objects: Mobile Agents with Strict Preferences

abstract: In recent work, Gourv\`es, Lesca, and Wilczynski propose a variant of the classic housing markets model where the matching between agents and objects evolves through Pareto-improving swaps between pairs of adjacent agents in a social network. To explore the swap dynamics of their model, they pose several basic questions concerning the set of reachable matchings. In their work and other follow-up works, these questions have been studied for various classes of graphs: stars, paths, generalized stars (i.e., trees where at most one vertex has degree greater than two), trees, and cliques. For generalized stars and trees, it remains open whether a Pareto-efficient reachable matching can be found in polynomial time. In this paper, we pursue the same set of questions under a natural variant of their model. In our model, the social network is replaced by a network of objects, and a swap is allowed to take place between two agents if it is Pareto-improving and the associated objects are adjacent in the network. In those cases where the question of polynomial-time solvability versus NP-hardness has been resolved for the social network model, we are able to show that the same result holds for the network-of-objects model. In addition, for our model, we present a polynomial-time algorithm for computing a Pareto-efficient reachable matching in generalized star networks. Moreover, the object reachability algorithm that we present for path networks is significantly faster than the known polynomial-time algorithms for the same question in the social network model.


title: The Fusemate Logic Programming System (System Description)

abstract: Fusemate is a logic programming system that implements the possible model semantics for disjunctive logic programs. Its input language is centered around a weak notion of stratification with comprehension and aggregation operators on top of it. Fusemate is implemented as a shallow embedding in the Scala programming language. This enables using Scala data types natively as terms, a tight interface with external systems, and it makes model computation available as an ordinary container data structure constructor. The paper describes the above features and demonstrates them with a non-trivial use-case, the embedding of the description logic $\cal ALCIF$ into Fusemate's input language This version of the paper corrects an error in the published version, which used an unsuitable version of "blocking" in the $\cal ALCIF$ embedding.


title: DeepReDuce: ReLU Reduction for Fast Private Inference

abstract: The recent rise of privacy concerns has led researchers to devise methods for private neural inference -- where inferences are made directly on encrypted data, never seeing inputs. The primary challenge facing private inference is that computing on encrypted data levies an impractically-high latency penalty, stemming mostly from non-linear operators like ReLU. Enabling practical and private inference requires new optimization methods that minimize network ReLU counts while preserving accuracy. This paper proposes DeepReDuce: a set of optimizations for the judicious removal of ReLUs to reduce private inference latency. The key insight is that not all ReLUs contribute equally to accuracy. We leverage this insight to drop, or remove, ReLUs from classic networks to significantly reduce inference latency and maintain high accuracy. Given a target network, DeepReDuce outputs a Pareto frontier of networks that tradeoff the number of ReLUs and accuracy. Compared to the state-of-the-art for private inference DeepReDuce improves accuracy and reduces ReLU count by up to 3.5% (iso-ReLU count) and 3.5$\times$ (iso-accuracy), respectively.


title: Finite time Convergence of Pinning Synchronization with Linear and Nonlinear Controllers

abstract: In this paper, we propose several models, which can realize synchronization of complex networks in finite time effectively. The results apply to heterogeneous dynamic networks, too. The mechanism of finite time convergence is revealed. Different from many models, which assume the coupling matrix being symmetric (or the connecting graph is undirected), here, the coupling matrix is asymmetric (or the connecting graph is directed).


title: Approximation Algorithms for Orthogonal Non-negative Matrix Factorization

abstract: In the non-negative matrix factorization (NMF) problem, the input is an $m\times n$ matrix $M$ with non-negative entries and the goal is to factorize it as $M\approx AW$. The $m\times k$ matrix $A$ and the $k\times n$ matrix $W$ are both constrained to have non-negative entries. This is in contrast to singular value decomposition, where the matrices $A$ and $W$ can have negative entries but must satisfy the orthogonality constraint: the columns of $A$ are orthogonal and the rows of $W$ are also orthogonal. The orthogonal non-negative matrix factorization (ONMF) problem imposes both the non-negativity and the orthogonality constraints, and previous work showed that it leads to better performances than NMF on many clustering tasks. We give the first constant-factor approximation algorithm for ONMF when one or both of $A$ and $W$ are subject to the orthogonality constraint. We also show an interesting connection to the correlation clustering problem on bipartite graphs. Our experiments on synthetic and real-world data show that our algorithm achieves similar or smaller errors compared to previous ONMF algorithms while ensuring perfect orthogonality (many previous algorithms do not satisfy the hard orthogonality constraint).


title: Hindi-Urdu Adposition and Case Supersenses v1.0

abstract: These are the guidelines for the application of SNACS (Semantic Network of Adposition and Case Supersenses; Schneider et al. 2018) to Modern Standard Hindi of Delhi. SNACS is an inventory of 50 supersenses (semantic labels) for labelling the use of adpositions and case markers with respect to both lexical-semantic function and relation to the underlying context. The English guidelines (Schneider et al., 2020) were used as a model for this document. Besides the case system, Hindi has an extremely rich adpositional system built on the oblique genitive, with productive incorporation of loanwords even in present-day Hinglish. This document is aligned with version 2.5 of the English guidelines.


title: Smoothness Analysis of Adversarial Training

abstract: Deep neural networks are vulnerable to adversarial attacks. Recent studies about adversarial robustness focus on the loss landscape in the parameter space since it is related to optimization and generalization performance. These studies conclude that the difficulty of adversarial training is caused by the non-smoothness of the loss function: i.e., its gradient is not Lipschitz continuous. However, this analysis ignores the dependence of adversarial attacks on model parameters. Since adversarial attacks are optimized for models, they should depend on the parameters. Considering this dependence, we analyze the smoothness of the loss function of adversarial training using the optimal attacks for the model parameter in more detail. We reveal that the constraint of adversarial attacks is one cause of the non-smoothness and that the smoothness depends on the types of the constraints. Specifically, the $L_\infty$ constraint can cause non-smoothness more than the $L_2$ constraint. Moreover, our analysis implies that if we flatten the loss function with respect to input data, the Lipschitz constant of the gradient of adversarial loss tends to increase. To address the non-smoothness, we show that EntropySGD smoothens the non-smooth loss and improves the performance of adversarial training.


title: The Yang-Mills duals of small AdS black holes

abstract: We study the large $N$ matrix model for the index of 4d $\mathcal{N}=4$ Yang-Mills theory and its truncations to understand the dual AdS$_5$ black holes. Numerical studies of the truncated models provide insights on the black hole physics, some of which we investigate analytically with the full Yang-Mills matrix model. In particular, we find many branches of saddle points which describe the known black hole solutions. We analytically construct the saddle points dual to the small black holes whose sizes are much smaller than the AdS radius. They include the asymptotically flat BMPV black holes embedded in large AdS with novel thermodynamic instabilities.


title: Maximal and Maximum Dissociation Sets in General and Triangle-Free Graphs

abstract: A subset of vertices $F$ in a graph $G$ is called a \emph{dissociation set} if the induced subgraph $G[F]$ of $G$ has maximum degree at most 1. A \emph{maximal dissociation set} of $G$ is a dissociation set which is not a proper subset of any other dissociation sets. A \emph{maximum dissociation set} is a dissociation set of maximum size. We show that every graph of order $n$ has at most $10^{\frac{n}{5}}$ maximal dissociation sets, and that every triangle-free graph of order $n$ has at most $6^{\frac{n}{4}}$ maximal dissociation sets. We also characterize the extremal graphs on which these upper bounds are attained. The tight upper bounds on the number of maximum dissociation sets in general and triangle-free graphs are also obtained.


title: A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and Semantics

abstract: Inspired by humans' exceptional ability to master arithmetic and generalize to new problems, we present a new dataset, Handwritten arithmetic with INTegers (HINT), to examine machines' capability of learning generalizable concepts at three levels: perception, syntax, and semantics. In HINT, machines are tasked with learning how concepts are perceived from raw signals such as images (i.e., perception), how multiple concepts are structurally combined to form a valid expression (i.e., syntax), and how concepts are realized to afford various reasoning tasks (i.e., semantics), all in a weakly supervised manner. Focusing on systematic generalization, we carefully design a five-fold test set to evaluate both the interpolation and the extrapolation of learned concepts w.r.t. the three levels. Further, we design a few-shot learning split to determine whether or not models can rapidly learn new concepts and generalize them to more complex scenarios. To comprehend existing models' limitations, we undertake extensive experiments with various sequence-to-sequence models, including RNNs, Transformers, and GPT-3 (with the chain of thought prompting). The results indicate that current models struggle to extrapolate to long-range syntactic dependency and semantics. Models exhibit a considerable gap toward human-level generalization when evaluated with new concepts in a few-shot setting. Moreover, we discover that it is infeasible to solve HINT by merely scaling up the dataset and the model size; this strategy contributes little to the extrapolation of syntax and semantics. Finally, in zero-shot GPT-3 experiments, the chain of thought prompting exhibits impressive results and significantly boosts the test accuracy. We believe the HINT dataset and the experimental findings are of great interest to the learning community on systematic generalization.


title: A packaged whispering gallery resonator device based on an optical nanoantenna coupler

abstract: In this work, we present the design and fabrication of a packaged whispering gallery mode (WGM) device based on an optical nanoantenna as the coupler and a glass microsphere as the resonator. The microspheres were fabricated from SiO$_2$ fiber or Er$^{3+}$-doped fiber, the latter creating a WGM laser with a threshold of 93 $\mu$W at 1531 nm. The coupler-resonator WGM device is packaged in a glass capillary. The performance of the packaged microlaser is characterized, with lasing emission both excited in and collected from the WGM cavity via the nanoantenna. The packaged system provides isolation from environmental contamination, a small size, and unidirectional coupling while maintaining a high quality (Q-) factor ($\sim$10$^8$). It opens up new possibilities for practical applications of WGM microdevices in a variety of fields such as low threshold lasers, filters, and sensors.


title: Fundamental solutions for the Dirac equation in curved spacetime and generalized Euler-Poisson-Darboux equation

abstract: We present the fundamental solutions for the spin-1/2 fields propagating in the spacetimes with power type expansion/contraction and the fundamental solution of the Cauchy problem for the Dirac equation. The derivation of these fundamental solutions is based on formulas for the solutions to the generalized Euler-Poisson-Darboux equation, which are obtained by the integral transform approach.


title: The Secure Domination Number of Cartesian Products of Small Graphs with Paths and Cycles

abstract: The secure domination numbers of the Cartesian products of two small graphs with paths or cycles is determined, as well as for Mobius ladder graphs. Prior to this work, in all cases where the secure domination number has been determined, the proof has either been trivial, or has been derived from lower bounds established by considering different forms of domination. However, the latter mode of proof is not applicable for most graphs, including those considered here. Hence, this work represents the first attempt to determine secure domination numbers via the properties of secure domination itself, and it is expected that these methods may be used to determine further results in the future.


title: On the maximum number of maximum dissociation sets in trees with given dissociation number

abstract: In a graph $G$, a subset of vertices is a dissociation set if it induces a subgraph with vertex degree at most 1. A maximum dissociation set is a dissociation set of maximum cardinality. The dissociation number of $G$, denoted by $\psi(G)$, is the cardinality of a maximum dissociation set of $G$. Extremal problems involving counting the number of a given type of substructure in a graph have been a hot topic of study in extremal graph theory throughout the last few decades. In this paper, we determine the maximum number of maximum dissociation sets in a tree with prescribed dissociation number and the extremal trees achieving this maximum value.


title: Tunable bandgaps and symmetry breaking in magneto-mechanical metastructures inspired by multi-layer 2D materials

abstract: In this Letter, we introduce a paradigm to realize magneto-mechanical metastructures inspired by multi-layer 2D materials, such as graphene bilayers. The metastructures are intended to capture two aspects of their nanoscale counterparts. One is the multi-layer geometry, which is implemented by stacking hexagonal lattice sheets. The other is the landscape of weak inter-layer forces, which is mimicked by the interactions between pairs of magnets located at corresponding lattice sites on adjacent layers. We illustrate the potential of this paradigm through a three-layer prototype. The two rigid outer lattices serve as control layers, while the thin inner layer is free to experience flexural motion under the confining action of the magnetic forces exchanged with the outer ones, thus behaving as a lattice on elastic foundation. The inner layer is free to rotate relatively to the others, giving rise to a rich spectrum of inter-layer interaction patterns. Our objective is to determine how the dynamical response can be tuned by changing the twist angle between the layers. Specifically, we demonstrate experimentally that switching between different stacking patterns has profound consequences on the phonon landscape, opening and closing bandgaps in different frequency regimes.


title: BPActuators: Lightweight and Low-Cost Soft Actuators by Balloons and Plastics

abstract: To increase the awareness and impact, soft robotics needs to go beyond the lab environment and should be readily accessible to those even with no robotic expertise. However, most prevailing manufacturing methodologies require either professional equipment or materials that are not usually available to common people, thereby constraining the accessibility of soft robotics. In this communication, we propose a lightweight and low-cost soft bending actuator, called BPActuator, that can be easily fabricated with plastics and balloons. We fabricated a range of actuators with various morphology for characterization in terms of deformation and load-bearing capacity, and demonstrated that they can bend up to 35 degrees and exert force at the tip around 0.070$\pm$0.015N, which is over 5 times higher than their average gravity. We further implemented a gripper with three fingers using the proposed actuators, and found that the gripper can realize human-like grasp of a range of daily objects. The gripper can lift objects at least 8 times heavier than its own weight. Furthermore, the BPActuator is cost effective and each costs about 0.22 USD. Given these advantages, the BPActuators are expected to significantly improve the accessibility of soft robotics to a wider group without robotic expertise.


title: Implications of an improved water equation of state for water-rich planets

abstract: Water (H$_{2}$O), in all forms, is an important constituent in planetary bodies, controlling habitability and influencing geological activity. Under conditions found in the interior of many planets, as the pressure increases, the H-bonds in water gradually weaken and are replaced by ionic bonds. Recent experimental measurements of the water equation of state (EOS) showed both a new phase of H-bonded water ice, ice-VII$_t$, and a relatively low transition pressure just above 30 GPa to ionic bonded ice-X, which has a bulk modulus 2.5 times larger. The higher bulk modulus of ice-X produces larger planets for a given mass, thereby either reducing the atmospheric contribution to the volume of many exoplanets or limiting their water content. We investigate the impact of the new EOS measurements on the planetary mass-radius relation and interior structure for water-rich planets. We find that the change in the planet mass-radius relation caused by the systematic differences between previous and new experimental EOS measurements are comparable to the observational uncertainties in some planet sizes -- an issue that will become more important as observations continue to improve.


title: Diffractive rho + lepton pair production at an electron-ion collider

abstract: In high energy electron-ion colliders, a new way to probe nucleon structure becomes available through diffractive reactions, where the incident particle produces a very energetic almost forward particle. QCD describes these reactions as due to the exchange of a Pomeron which may be perturbatively described as a dressed two-gluon state, provided a hard scale allows the factorization of the amplitude in terms of two impact factors convoluted with a Pomeron propagator. We consider here a process where such a description allows to access hadronic structure in terms of the generalized parton distributions, namely the electroproduction of a forward $\rho$ meson and a timelike deeply virtual photon, separated by a large rapidity gap. We explore the dependence of the cross section on the kinematic variables and study the dependence on the non-perturbative inputs (generalized parton distributions, distribution amplitude). Our leading order studies show the cross section is mainly sensitive to the GPD model input, but the small size of the cross sections could prohibit straightforward analysis of this process at planned facilities.


title: Some Finite Sample Properties of the Sign Test

abstract: This paper contains two finite-sample results concerning the sign test. First, we show that the sign-test is unbiased with independent, non-identically distributed data for both one-sided and two-sided hypotheses. The proof for the two-sided case is based on a novel argument that relates the derivatives of the power function to a regular bipartite graph. Unbiasedness then follows from the existence of perfect matchings on such graphs. Second, we provide a simple theoretical counterexample to show that the sign test over-rejects when the data exhibits correlation. Our results can be useful for understanding the properties of approximate randomization tests in settings with few clusters.


title: Safe Learning of Uncertain Environments

abstract: In many learning based control methodologies, learning the unknown dynamic model precedes the control phase, while the aim is to control the system such that it remains in some safe region of the state space. In this work, our aim is to guarantee safety while learning and control proceed simultaneously. Specifically, we consider the problem of safe learning in nonlinear control-affine systems subject to unknown additive uncertainty. We first model the uncertainty as a Gaussian noise and use state measurements to learn its mean and covariance. We provide rigorous time-varying bounds on the mean and covariance of the uncertainty and employ them to modify the control input via an optimization program with potentially time-varying safety constraints. We show that with an arbitrarily large probability we can guarantee that the state will remain in the safe set, while learning and control are carried out simultaneously, provided that a feasible solution exists for the optimization problem. We provide a secondary formulation of this optimization that is computationally more efficient. This is based on tightening the safety constraints to counter the uncertainty about the learned mean and covariance. The magnitude of the tightening can be decreased as our confidence in the learned mean and covariance increases (i.e., as we gather more measurements about the environment). Extensions of the method are provided for non-Gaussian process noise with unknown mean and covariance as well as Gaussian uncertainties with state-dependent mean and covariance to accommodate more general environments.


title: A general approach to sample path generation of infinitely divisible processes via shot noise representation

abstract: We establish a sample path generation scheme in a unified manner for general multivariate infinitely divisible processes based on shot noise representation of their integrators. The approximation is derived from the decomposition of the infinitely divisible process to three independent components based on jump sizes and timings: the large jumps over a compact time interval, small jumps over the entire time interval and large jumps over an unbounded time interval. The first component is taken as the approximation and is much simpler than simulation of general Gaussian processes, while the latter two components are analyzed as the error. We derive technical conditions for the two error terms to vanish in the limit and for the scaled component on small jumps to converge to a Gaussian process so as to enhance the accuracy of the weak approximation. We provide an extensive collection of examples to highlight the wide practicality of the proposed approach.


title: A Survey of Deep Learning Techniques for Weed Detection from Images

abstract: The rapid advances in Deep Learning (DL) techniques have enabled rapid detection, localisation, and recognition of objects from images or videos. DL techniques are now being used in many applications related to agriculture and farming. Automatic detection and classification of weeds can play an important role in weed management and so contribute to higher yields. Weed detection in crops from imagery is inherently a challenging problem because both weeds and crops have similar colours ('green-on-green'), and their shapes and texture can be very similar at the growth phase. Also, a crop in one setting can be considered a weed in another. In addition to their detection, the recognition of specific weed species is essential so that targeted controlling mechanisms (e.g. appropriate herbicides and correct doses) can be applied. In this paper, we review existing deep learning-based weed detection and classification techniques. We cover the detailed literature on four main procedures, i.e., data acquisition, dataset preparation, DL techniques employed for detection, location and classification of weeds in crops, and evaluation metrics approaches. We found that most studies applied supervised learning techniques, they achieved high classification accuracy by fine-tuning pre-trained models on any plant dataset, and past experiments have already achieved high accuracy when a large amount of labelled data is available.


title: Quantifying non-Markovianity via conditional mutual information

abstract: In this paper, we study measures of quantum non-Markovianity based on the conditional mutual information. We obtain such measures by considering multiple parts of the total environment such that the conditional mutual information can be defined in this multipartite setup. The benefit of this approach is that the conditional mutual information is closely related to recovery maps and Markov chains; we also point out its relations with the change of distinguishability. We study along the way the properties of leaked information which is the conditional mutual information that can be back flowed, and we use this leaked information to show that the correlated environment is necessary for nonlocal memory effect.


title: Existence of log canonical modifications and its applications

abstract: The main purpose of this paper is to establish some useful partial resolutions of singularities for pairs from the minimal model theoretic viewpoint. We first establish the existence of log canonical modifications of normal pairs under some suitable assumptions. It recovers Kawakita's inversion of adjunction on log canonicity in full generality. We also discuss the existence of semi-log canonical modifications for demi-normal pairs and construct dlt blow-ups with several extra good properties. As applications, we study lengths of extremal rational curves and so on.


title: Homogenization of locally periodic parabolic operators with non-self-similar scales

abstract: We investigate quantitative estimates in homogenization of the locally periodic parabolic operator with multiscales $$ \partial_t- \text{div} (A(x,t,x/\varepsilon,t/\kappa^2) \nabla ),\qquad \varepsilon>0,\, \kappa>0. $$ Under proper assumptions, we establish the full-scale interior and boundary Lipschitz estimates. These results are new even for the case $\kappa=\varepsilon$, and for the periodic operators $ \partial_t-\text{div}(A(x/\varepsilon, t/\varepsilon^{\ell}) \nabla ),$ $0<\varepsilon,\ell<\infty, $ of which the large-scale Lipschitz estimate down to $\varepsilon+\varepsilon^{\ell/2}$ was recently established by the first author and Shen in Arch. Ration. Mech. Anal. 236(1): 145--188 (2020). Due to the non-self-similar structure, the full-scale estimates do not follow directly from the large-scale estimates and the blow-up argument. As a byproduct, we also derive the convergence rates for the corresponding initial-Dirichlet problems, which extend the results in the aforementioned literature to more general settings.


title: Data-driven computation methods for quasi-stationary distribution and sensitivity analysis

abstract: This paper studies computational methods for quasi-stationary distributions (QSDs). We first proposed a data-driven solver that solves Fokker-Planck equations for QSDs. Similar as the case of Fokker-Planck equations for invariant probability measures, we set up an optimization problem that minimizes the distance from a low-accuracy reference solution, under the constraint of satisfying the linear relation given by the discretized Fokker-Planck operator. Then we use coupling method to study the sensitivity of a QSD against either the change of boundary condition or the diffusion coefficient. The 1-Wasserstein distance between a QSD and the corresponding invariant probability measure can be quantitatively estimated. Some numerical results about both computation of QSDs and their sensitivity analysis are provided.


title: Noether-Fano Inequalities and Canonical Thresholds on Fano Varieties

abstract: We prove a more general and precise version of the Noether-Fano inequalities for birational maps between Mori fiber spaces. This is applied to give descriptions of global canonical thresholds on Fano varieties of Picard number one.


title: Unsupervised Word Segmentation with Bi-directional Neural Language Model

abstract: We present an unsupervised word segmentation model, in which the learning objective is to maximize the generation probability of a sentence given its all possible segmentation. Such generation probability can be factorized into the likelihood of each possible segment given the context in a recursive way. In order to better capture the long- and short-term dependencies, we propose to use bi-directional neural language models to better capture the features of segment's context. Two decoding algorithms are also described to combine the context features from both directions to generate the final segmentation, which helps to reconcile word boundary ambiguities. Experimental results showed that our context-sensitive unsupervised segmentation model achieved state-of-the-art at different evaluation settings on various data sets for Chinese, and the comparable result for Thai.


title: Adaptive Transmission Scheduling in Wireless Networks for Asynchronous Federated Learning

abstract: In this paper, we study asynchronous federated learning (FL) in a wireless distributed learning network (WDLN). To allow each edge device to use its local data more efficiently via asynchronous FL, transmission scheduling in the WDLN for asynchronous FL should be carefully determined considering system uncertainties, such as time-varying channel and stochastic data arrivals, and the scarce radio resources in the WDLN. To address this, we propose a metric, called an effectivity score, which represents the amount of learning from asynchronous FL. We then formulate an Asynchronous Learning-aware transmission Scheduling (ALS) problem to maximize the effectivity score and develop three ALS algorithms, called ALSA-PI, BALSA, and BALSA-PO, to solve it. If the statistical information about the uncertainties is known, the problem can be optimally and efficiently solved by ALSA-PI. Even if not, it can be still optimally solved by BALSA that learns the uncertainties based on a Bayesian approach using the state information reported from devices. BALSA-PO suboptimally solves the problem, but it addresses a more restrictive WDLN in practice, where the AP can observe a limited state information compared with the information used in BALSA. We show via simulations that the models trained by our ALS algorithms achieve performances close to that by an ideal benchmark and outperform those by other state-of-the-art baseline scheduling algorithms in terms of model accuracy, training loss, learning speed, and robustness of learning. These results demonstrate that the adaptive scheduling strategy in our ALS algorithms is effective to asynchronous FL.


title: Inclusion-Exclusion Principle for Open Quantum Systems with Bosonic Bath

abstract: We present two fast algorithms which apply inclusion-exclusion principle to sum over the bosonic diagrams in bare diagrammatic quantum Monte Carlo (dQMC) and inchworm Monte Carlo method, respectively. In the case of inchworm Monte Carlo, the proposed fast algorithm gives an extension to the work ["Inclusion-exclusion principle for many-body diagrammatics", Phys. Rev. B, 98:115152, 2018] from fermionic to bosonic systems. We prove that the proposed fast algorithms reduce the computational complexity from double factorial to exponential. Numerical experiments are carried out to verify the theoretical results and to compare the efficiency of the methods.


title: More variable quasars have stronger emission lines

abstract: The UV/optical variation, likely driven by accretion disc turbulence, is a defining characteristic of type 1 active galactic nuclei (AGNs) and quasars. In this work we investigate an interesting consequence of such turbulence using quasars in SDSS Stripe 82 for which the measurements of the UV/optical variability amplitude are available from $\sim$ 10 years long light curves. We discover positive correlations between UV/optical variability amplitude $\sigma_{rms}$ and equivalent widths of CIV, Mg II and [OIII]5007 emission lines. Such correlations remain statistically robust through partial correlation analyses, i.e., after controlling the effects of other variables including bolometric luminosity, central supermassive black hole mass, Eddington ratio and redshift. This, for the first time, indicates a causal link between disc turbulence and emission line production. We propose two potential underlying mechanisms both of which may be involved: 1) quasars with stronger disc turbulence have on average bluer/harder broadband SED, an expected effect of the disc thermal fluctuation model; 2) stronger disc turbulence could lead to launch of emission line regions with larger covering factors.


title: On the analysis of signal peaks in pulse-height spectra

abstract: The estimation of the signal location and intensity of a peak in a pulse height spectrum is important for x-ray and $\gamma$-ray spectroscopy, charged-particle spectrometry, liquid chromatography, and many other subfields. However, both the "centroid" and "signal intensity" of a peak in a pulse-height spectrum are ill-defined quantities and different methods of analysis will yield different numerical results. Here, we apply three methods of analysis. Method A is based on simple count summation and is likely the technique most frequently applied in practice. The analysis is straightforward and fast, and does not involve any statistical modeling. We find that it provides reliable results only for high signal-to-noise data, but has severe limitations in all other cases. Method B employs a Bayesian model to extract signal counts and centroid from the measured total and background counts. The resulting values are derived from the respective posteriors and, therefore, have a rigorous statistical meaning. The method makes no assumptions about the peak shape. It yields reliable and relatively small centroid uncertainties. However, it provides relatively large signal count uncertainties. Method C makes a strong assumption regarding the peak shape by fitting a Gaussian function to the data. The fit is based again on a Bayesian model. Although Method C requires careful consideration of the Gaussian width (usually given by the detector resolution) used in the fitting, it provides reliable values and relatively small uncertainties both for the signal counts and the centroid.


title: AdeNet: Deep learning architecture that identifies damaged electrical insulators in power lines

abstract: Ceramic insulators are important to electronic systems, designed and installed to protect humans from the danger of high voltage electric current. However, insulators are not immortal, and natural deterioration can gradually damage them. Therefore, the condition of insulators must be continually monitored, which is normally done using UAVs. UAVs collect many images of insulators, and these images are then analyzed to identify those that are damaged. Here we describe AdeNet as a deep neural network designed to identify damaged insulators, and test multiple approaches to automatic analysis of the condition of insulators. Several deep neural networks were tested, as were shallow learning methods. The best results (88.8\%) were achieved using AdeNet without transfer learning. AdeNet also reduced the false negative rate to $\sim$7\%. While the method cannot fully replace human inspection, its high throughput can reduce the amount of labor required to monitor lines for damaged insulators and provide early warning to replace damaged insulators.


title: String Scale Thermal Anti-de Sitter Spaces

abstract: We study finite temperature string scale $AdS_3$ backgrounds. One background is $AdS_3 \times S^1 \times T^2$ in which the anti-de Sitter space-time and the circle are at the radius $\sqrt{\alpha'}$. Using path integral techniques, we show that the bulk spectrum includes a continuum of states as well as Ramond-Ramond ground states that agree with those of the symmetric orbifold of the two-torus after second quantization. We also examine the one-loop free energy of the background $AdS_3 \times S^1$ at curvature radius $\sqrt{2 \alpha'/3}$. In the space-time NSNS sector, the string theory spontaneously breaks conformal symmetry as well as R-charge conjugation symmetry. We prove that the minimum in the boundary energy is reached for a singly wound string. In the RR sector, we classify the infinite set of ground states with fractional R-charges. Moreover, we remark on the behaviour of critical temperatures as the curvature scale becomes smaller than the string scale. In an appendix, we derive the Hawking-Page transition in string theory by integrating a world sheet one-point function.


title: Botcha: Detecting Malicious Non-Human Traffic in the Wild

abstract: Malicious bots make up about a quarter of all traffic on the web, and degrade the performance of personalization and recommendation algorithms that operate on e-commerce sites. Positive-Unlabeled learning (PU learning) provides the ability to train a binary classifier using only positive (P) and unlabeled (U) instances. The unlabeled data comprises of both positive and negative classes. It is possible to find labels for strict subsets of non-malicious actors, e.g., the assumption that only humans purchase during web sessions, or clear CAPTCHAs. However, finding signals of malicious behavior is almost impossible due to the ever-evolving and adversarial nature of bots. Such a set-up naturally lends itself to PU learning. Unfortunately, standard PU learning approaches assume that the labeled set of positives are a random sample of all positives, this is unlikely to hold in practice. In this work, we propose two modifications to PU learning that make it more robust to violations of the selected-completely-at-random assumption, leading to a system that can filter out malicious bots. In one public and one proprietary dataset, we show that proposed approaches are better at identifying humans in web data than standard PU learning methods.


title: Phase diagram and orbital Chern insulator in twisted double bilayer graphene

abstract: Compared with twisted bilayer graphene, twisted double bilayer graphene (TDBG) provides another important platform to realize the moir\'e flat bands. In this paper, we first calculate the valley Chern number phase diagram of TDBG in the parameter space spanned by the twist angle and the interlayer electric potential. To include the effects of interactions, we then phenomenologically introduce the spin-splitting and valley-splitting. We find that when the valley splitting is larger than the bandwidth of the first conduction band so that a gap is opened and the spin splitting is relatively weak, the orbital Chern insulator emerges at half-filling, associated with a large orbital magnetization (OM). Further calculations suggest that there is no sign reversal of the OM when the Fermi energy goes from the bottom to the top of the half-filling gap, as the OM remains negative in both AB-AB stacking and AB-BA stacking. The implications of our results for the ongoing experiments are also discussed.


title: The rates of growth in an acylindrically hyperbolic group

abstract: Let $G$ be an acylindrically hyperbolic group on a $\delta$-hyperbolic space $X$. Assume there exists $M$ such that for any finite generating set $S$ of $G$, the set $S^M$ contains a hyperbolic element on $X$. Suppose that $G$ is equationally Noetherian. Then we show the set of the growth rates of $G$ is well-ordered (Theorem 1.1). The conclusion was known for hyperbolic groups, and this is a generalization. Our result applies to all lattices in simple Lie groups of rank-1 (Theorem 1.3), and more generally, some family of relatively hyperbolic groups (Theorem 1.2). It also applies to the fundamental group, of exponential growth, of a closed orientable $3$-manifold except for the case that the manifold has Sol-geometry (Theorem 5.7).


title: A Method for Pulsar Searching: Combining a Two-dimensional Autocorrelation Profile Map and a Deep Convolutional Neural Network

abstract: In pulsar astronomy, detecting effective pulsar signals among numerous pulsar candidates is an important research topic. Starting from space X-ray pulsar signals, the two-dimensional autocorrelation profile map (2D-APM) feature modelling method, which utilizes epoch folding of the autocorrelation function of X-ray signals and expands the time-domain information of the periodic axis, is proposed. A uniform setting criterion regarding the time resolution of the periodic axis addresses pulsar signals without any prior information. Compared with the traditional profile, the model has a strong anti-noise ability, a greater abundance of information and consistent characteristics. The new feature is simulated with double Gaussian components, and the characteristic distribution of the model is revealed to be closely related to the distance between the double peaks of the profile. Next, a deep convolutional neural network (DCNN) is built, named Inception-ResNet. According to the order of the peak separation and number of arriving photons, 30 data sets based on the Poisson process are simulated to construct the training set, and the observation data of PSRs B0531+21, B0540-69 and B1509-58 from the Rossi X-ray Timing Explorer (RXTE) are selected to generate the test set. The number of training sets and the number of test sets are 30,000 and 5,400, respectively. After achieving convergence stability, more than 99$\%$ of the pulsar signals are recognized, and more than 99$\%$ of the interference is successfully rejected, which verifies the high degree of agreement between the network and the feature model and the high potential of the proposed method in searching for pulsars.


title: TopicTracker: A Platform for Topic Trajectory Identification and Visualisation

abstract: Topic trajectory information provides crucial insight into the dynamics of topics and their evolutionary relationships over a given time. Also, this information can help to improve our understanding on how new topics have emerged or formed through a sequential or interrelated events of emergence, modification and integration of prior topics. Nevertheless, the implementation of the existing methods for topic trajectory identification is rarely available as usable software. In this paper, we present TopicTracker, a platform for topic trajectory identification and visualisation. The key of Topic Tracker is that it can represent the three facets of information together, given two kinds of input: a time-stamped topic profile consisting of the set of the underlying topics over time, and the evolution strength matrix among them: evolutionary pathways of dynamic topics, evolution states of the topics, and topic importance. TopicTracker is a publicly available software implemented using the R software.


title: Jamming Aided Covert Communication with Multiple Receivers

abstract: We consider that a transmitter covertly communicates with multiple receivers under the help of a friendly jammer. The messages intended for different receivers are transmitted in mutually orthogonal frequency bands. An adversary observes all these frequency bands aiming at detecting whether or not communication occurs, while the friendly jammer broadcasts jamming signals to degrade the detection performance of the adversary. We consider a block Rayleigh fading channel model and evaluate the performance of covert communication in two situations: 1) the wireless channels vary slowly such that the transmission ends within one channel coherent time block, and 2) the wireless channels vary fast such that the wireless channels have changed several times before the whole transmission is finished. In the former case, subject to a covertness constraint, we maximize the sum of the effective rates by optimizing the transmit power allocation and the transmission rate for each receiver. In the latter case, we take the channel training process into consideration, and subject to a covertness constraint, we maximize the sum of the ergodic rates by optimizing the power allocation and the pilot length. Though both of the two optimization problems are non-convex, we presented methods to find their global optimal solutions. Besides, we also present methods to find sub-optimal solutions with lower computational complexities. Numerical results are presented to evaluate the performance under the two situations.


title: Learning Robotic Manipulation Tasks via Task Progress based Gaussian Reward and Loss Adjusted Exploration

abstract: Multi-step manipulation tasks in unstructured environments are extremely challenging for a robot to learn. Such tasks interlace high-level reasoning that consists of the expected states that can be attained to achieve an overall task and low-level reasoning that decides what actions will yield these states. We propose a model-free deep reinforcement learning method to learn multi-step manipulation tasks. We introduce a Robotic Manipulation Network (RoManNet), which is a vision-based model architecture, to learn the action-value functions and predict manipulation action candidates. We define a Task Progress based Gaussian (TPG) reward function that computes the reward based on actions that lead to successful motion primitives and progress towards the overall task goal. To balance the ratio of exploration/exploitation, we introduce a Loss Adjusted Exploration (LAE) policy that determines actions from the action candidates according to the Boltzmann distribution of loss estimates. We demonstrate the effectiveness of our approach by training RoManNet to learn several challenging multi-step robotic manipulation tasks in both simulation and real-world. Experimental results show that our method outperforms the existing methods and achieves state-of-the-art performance in terms of success rate and action efficiency. The ablation studies show that TPG and LAE are especially beneficial for tasks like multiple block stacking. Code is available at: https://github.com/skumra/romannet


title: Improved Techniques for Quantizing Deep Networks with Adaptive Bit-Widths

abstract: Quantizing deep networks with adaptive bit-widths is a promising technique for efficient inference across many devices and resource constraints. In contrast to static methods that repeat the quantization process and train different models for different constraints, adaptive quantization enables us to flexibly adjust the bit-widths of a single deep network during inference for instant adaptation in different scenarios. While existing research shows encouraging results on common image classification benchmarks, this paper investigates how to train such adaptive networks more effectively. Specifically, we present two novel techniques for quantizing deep neural networks with adaptive bit-widths of weights and activations. First, we propose a collaborative strategy to choose a high-precision teacher for transferring knowledge to the low-precision student while jointly optimizing the model with all bit-widths. Second, to effectively transfer knowledge, we develop a dynamic block swapping method by randomly replacing the blocks in the lower-precision student network with the corresponding blocks in the higher-precision teacher network. Extensive experiments on multiple image classification datasets including video classification benchmarks for the first time, well demonstrate the efficacy of our approach over state-of-the-art methods.


title: ForceNet: A Graph Neural Network for Large-Scale Quantum Calculations

abstract: With massive amounts of atomic simulation data available, there is a huge opportunity to develop fast and accurate machine learning models to approximate expensive physics-based calculations. The key quantity to estimate is atomic forces, where the state-of-the-art Graph Neural Networks (GNNs) explicitly enforce basic physical constraints such as rotation-covariance. However, to strictly satisfy the physical constraints, existing models have to make tradeoffs between computational efficiency and model expressiveness. Here we explore an alternative approach. By not imposing explicit physical constraints, we can flexibly design expressive models while maintaining their computational efficiency. Physical constraints are implicitly imposed by training the models using physics-based data augmentation. To evaluate the approach, we carefully design a scalable and expressive GNN model, ForceNet, and apply it to OC20 (Chanussot et al., 2020), an unprecedentedly-large dataset of quantum physics calculations. Our proposed ForceNet is able to predict atomic forces more accurately than state-of-the-art physics-based GNNs while being faster both in training and inference. Overall, our promising and counter-intuitive results open up an exciting avenue for future research.


title: Multiple positive solutions for the fractional Schr\"{o}dinger-Poisson systems involving critical nonlinearities with potential

abstract: In this paper, we study the existence of multiple positive solutions for a class of fractional Schr\"{o}dinger-Poisson systems involving sign-changing potential and critical nonlinearities on an unbounded domain. With the help of Nehari manifold and Ljusternik-Schnirelmann category, we investigate how the coefficient $g(x)$ of the critical nonlinearity affects the number of positive solutions. Moreover, we present a novel relationship between the number of positive solutions and the category of the global maximum set of $g(x)$.


title: Relative Khovanov-Jacobsson classes

abstract: To a smooth, compact, oriented, properly-embedded surface in the $4$-ball, we define an invariant of its boundary-preserving isotopy class from the Khovanov homology of its boundary link. Previous work showed that when the boundary link is empty, this invariant is determined by the genus of the surface. We show that this relative invariant: can obstruct sliceness of knots; detects a pair of slices for $9_{46}$; is not hindered by detecting connected sums with knotted $2$-spheres.


title: Fast Adaptation with Linearized Neural Networks

abstract: The inductive biases of trained neural networks are difficult to understand and, consequently, to adapt to new settings. We study the inductive biases of linearizations of neural networks, which we show to be surprisingly good summaries of the full network functions. Inspired by this finding, we propose a technique for embedding these inductive biases into Gaussian processes through a kernel designed from the Jacobian of the network. In this setting, domain adaptation takes the form of interpretable posterior inference, with accompanying uncertainty estimation. This inference is analytic and free of local optima issues found in standard techniques such as fine-tuning neural network weights to a new task. We develop significant computational speed-ups based on matrix multiplies, including a novel implementation for scalable Fisher vector products. Our experiments on both image classification and regression demonstrate the promise and convenience of this framework for transfer learning, compared to neural network fine-tuning. Code is available at https://github.com/amzn/xfer/tree/master/finite_ntk.


title: Magnetic slip casting: a review of current achievements and issues

abstract: Ceramic materials are ubiquitous in technologies operating under high mechanical, thermal or chemical constrains. Research in ceramic processing aims at creating ceramics with properties that are still challenging to obtain, such as toughness, transparency, conductivity, among others. Magnetic slip casting is a ceramic process where an external magnetic field is used to align the ceramic grains along preferential crystallographic directions, thereby creating controlled texture. Over the past 20 years of research on magnetic slip casting, ceramics of multiple chemistry were found to exhibit enhanced properties as a result from the texturation. This paper reviews the progress in the field of magnetic slip casting, details the processing parameters, the textures obtained for a diverse range of ceramic materials. The achieved mechanical and functional properties of the magnetically textured parts are presented. This overview of the magnetic slip casting process allows to identify critical directions for future advancement in advanced technical ceramics


title: Construction of coend and the reconstruction theorem of bialgebras

abstract: Assume $k$ is a field and let $F:C\rightarrow Vect_{k}$ be a small $k$-linear functor from a $k$-linear abelian category $C$ to the category of vector spaces over the field $k$, the purpose of this note is to use a little knowledge of linear algebra and category to give the description of $end(F)$ and $coend(F)$, and then we give the reconstruction theorem of bialgebras by using this description. We use a constructive approach to understand $end(F),coend(F)$ and we describe the bialgebra structure of $coend(F)$ concretely when $F$ is a tensor functor.


title: Assessment of Soot Formation Models in Lifted Ethylene/Air Turbulent Diffusion Flame

abstract: In the present study, soot formation in the turbulent lifted diffusion flame, consisting of ethylene-air is numerically investigated using three different soot modeling approaches and is comprehensively reported. For turbulence-chemistry interaction, Flamelet generated manifold (FGM) model is used. A detailed kinetics is used which is represented through POLIMI mechanism (Ranzi et al. 2012). Soot formation is modeled using two different approaches, semi-empirical two-equation approach and Quadrature methods of moments approach, where both the approaches consider various sub-processes such as nucleation, coagulation, surface growth and oxidation. The radiation heat transfer is taken into account considering four fictitious gasses in conjunction with the weighted-sum-of-gray gas (WSSGM) approach for modeling absorption coefficient. The experimental and earlier published numerical data from K\"ohler et al. (2012) and Blacha et al. (2011) are used for assessment of different soot modeling approaches. The discrepancies between numerical and experimental data are observed due to under-prediction of OH radicals concentration and poor fuel-air mixing ratios in the vicinity of the fuel jet region leading to early soot formation and the trends are unaffected after invoking radiation.


title: Bioinspired approaches to toughen calcium phosphate-based ceramics for bone repair

abstract: To respond to the increasing need for bone repair strategies, various types of biomaterials have been developed. Among those, calcium phosphate ceramics (CPCs) are promising since they possess a chemical composition similar to that of bones. To be suitable for implants, CPCs need to fulfill a number of biological and mechanical requirements. Fatigue resistance and toughness are two key mechanical properties that are still challenging to obtain in CPCs. This paper thus reviews and discusses current progress in the processing of CPCs with bioinspired microstructures for load-bearing applications. First, methods to obtain CPCs with bioinspired structure at individual lengthscales, namely nano-, micro-, and macroscale are discussed. Then, approaches to attain synergetic contribution of all lengthscales through a complex and biomimetic hierarchical structure are reviewed. The processing methods and their design capabilities are presented and the mechanical properties of the materials they can produce are analysed. Their limitations and challenges are finally discussed to suggest new directions for the fabrication of biomimetic bone implants with satisfactory properties. The paper could help biomedical researchers, materials scientists and engineers to join forces to create the next generation of bone implants.


title: Simulation of Coupled Heat and Mass Transport With Reaction in PEM Fuel Cell Cathode using Lattice Boltzmann Method

abstract: Fluid, heat and species transport and oxygen reduction in the cathode of a PEM fuel cell are simulated using multi relaxation lattice Boltzmann method. Heat generation due to oxygen reduction and its effects on transport and reaction are considered. Simulations for various cell operating voltages, temperatures and flow rates with various values of porous media properties, namely, permeability, porosity, and effective porous media diffusion coefficient, are performed to study transport and operating characteristics in the electrode. It is seen that maximum output power density achievable is limited by the mass transport rate. A small increase in current density is obtained by increasing the operating temperature. However, this results in an increase in the rate of heat generation. Permeability and porosity of the gas diffusion layer do not show a significant impact on the performance in the range of values presently simulated. Higher permeability, in turn, resulted in enhancement of thermal gradients in the porous layer. A significant increase in the maximum current density obtainable is observed with increase in flow rates. The higher convection associated with high flow rate facilitates better transport of species and heat at the catalyst layer resulting in larger current density with a lesser chance of hotspot formation. Increased species diffusion coefficient also resulted in increasing the power output substantially. In addition, the fuel utilization is also improved at high diffusion rates in the porous media. The study analyses and shows the impact of various operating and material parameters affecting the performance of a PEM fuel cell with special attention on enhancing the maximum power density attainable.


title: Porous textured ceramics with controlled grain size and orientation

abstract: Texture in dense or porous ceramics can enhance their functional and structural properties. Current methods for texturation employ anisotropic particles as starting powders and processes that drive their orientation into specific directions. Using ultra-low magnetic fields combined with slip casting, it is possible to purposely orient magnetically responsive particles in any direction. When those particles are suspended with nanoparticles, templated grain growth occurs during sintering to yield a textured ceramic. Yet, the final grains are usually micrometric, leading weak mechanical properties. Here, we explore how to tune the grain orientation size using magnetic slip casting and templated grain growth. Our strategy consists in changing the size of the anisotropic powders and ensuring that magnetic alignment and densification occurs. The obtained ceramics featured a large range of grain anisotropy, with submicrometric thickness and anisotropic properties. Textured ceramics with tunable grains dimensions and porosity are promising for filtering, biomedical or composite applications.


title: Sommerfeld-enhanced dark matter searches with dwarf spheroidal galaxies

abstract: We study observable signals from dark matter that self-annihilates via the Sommerfeld effect in dwarf spheroidal galaxies (dSphs). Since the effect of the Sommerfeld enhancement depends on the velocity of dark matter, it is crucial to determine the profile of dSphs to compute the J-factor, i.e., the line-of-sight integral of density squared. In our study we use the prior distributions of the parameters for satellite density profiles in order to determine the J-factor, making most out of the recent developments in the N-body simulations and semi-analytical modeling for the structure formation. As concrete models, we analyze fermionic dark matter that annihilates via a light scalar and Wino dark matter in supersymmetric models. We find that, with the more realistic prior distributions that we adopt in this study, the J-factor of the most promising dSphs is decreased by a factor of a few, compared with earlier estimates based on non-informative priors. Nevertheless, the Cherenkov Telescope Array should be able to detect the thermal Wino dark matter by pointing it toward best classical or ultrafaint dSphs for 500 hours.


title: ZeroSARAH: Efficient Nonconvex Finite-Sum Optimization with Zero Full Gradient Computation

abstract: We propose ZeroSARAH -- a novel variant of the variance-reduced method SARAH (Nguyen et al., 2017) -- for minimizing the average of a large number of nonconvex functions $\frac{1}{n}\sum_{i=1}^{n}f_i(x)$. To the best of our knowledge, in this nonconvex finite-sum regime, all existing variance-reduced methods, including SARAH, SVRG, SAGA and their variants, need to compute the full gradient over all $n$ data samples at the initial point $x^0$, and then periodically compute the full gradient once every few iterations (for SVRG, SARAH and their variants). Note that SVRG, SAGA and their variants typically achieve weaker convergence results than variants of SARAH: $n^{2/3}/\epsilon^2$ vs. $n^{1/2}/\epsilon^2$. Thus we focus on the variant of SARAH. The proposed ZeroSARAH and its distributed variant D-ZeroSARAH are the \emph{first} variance-reduced algorithms which \emph{do not require any full gradient computations}, not even for the initial point. Moreover, for both standard and distributed settings, we show that ZeroSARAH and D-ZeroSARAH obtain new state-of-the-art convergence results, which can improve the previous best-known result (given by e.g., SPIDER, SARAH, and PAGE) in certain regimes. Avoiding any full gradient computations (which are time-consuming steps) is important in many applications as the number of data samples $n$ usually is very large. Especially in the distributed setting, periodic computation of full gradient over all data samples needs to periodically synchronize all clients/devices/machines, which may be impossible or unaffordable. Thus, we expect that ZeroSARAH/D-ZeroSARAH will have a practical impact in distributed and federated learning where full device participation is impractical.


title: A materials perspective on the design of damage-resilient artificial bones and bone implants through additive/advanced manufacturing

abstract: After more than five decades of research, the failure of bone implants is still an issue that becomes increasingly urgent to solve in our ageing population. Among the reasons for failure, catastrophic brittle fracture is one event that is directly related to the implant s material and fabrication and that deserves more attention. Indeed, clinically available implants pale at reproducing the hierarchical and heterogeneous microstructural organization of our natural bones, ultimately failing at reproducing their mechanical strength and toughness. Nevertheless, the recent advances in additive and advanced manufacturing open new horizons for the fabrication of biomimetic bone implants, challenging at the same time their characterization, testing and modelling. This critical review covers selected recent achievements in bone implant research from a materials standpoint and aims at deciphering some of the most urgent issues in this multidisciplinary field.


title: Interpretable Hyperspectral AI: When Non-Convex Modeling meets Hyperspectral Remote Sensing

abstract: Hyperspectral imaging, also known as image spectrometry, is a landmark technique in geoscience and remote sensing (RS). In the past decade, enormous efforts have been made to process and analyze these hyperspectral (HS) products mainly by means of seasoned experts. However, with the ever-growing volume of data, the bulk of costs in manpower and material resources poses new challenges on reducing the burden of manual labor and improving efficiency. For this reason, it is, therefore, urgent to develop more intelligent and automatic approaches for various HS RS applications. Machine learning (ML) tools with convex optimization have successfully undertaken the tasks of numerous artificial intelligence (AI)-related applications. However, their ability in handling complex practical problems remains limited, particularly for HS data, due to the effects of various spectral variabilities in the process of HS imaging and the complexity and redundancy of higher dimensional HS signals. Compared to the convex models, non-convex modeling, which is capable of characterizing more complex real scenes and providing the model interpretability technically and theoretically, has been proven to be a feasible solution to reduce the gap between challenging HS vision tasks and currently advanced intelligent data processing models.


title: Investigation of NOx in piloted stabilized methane-air diffusion flames using Finite-rate and Infinitely-fast chemistry based combustion models

abstract: The present work reports on the numerical investigation of NOx in three turbulent piloted diffusion flames of different levels of extinction. The study involves two-dimensional axisymmetric modeling of combustion in these flames with fairly detailed chemistry, i.e. GRI 3.0 mechanism. The main focus of the study is to analyze the effects of the two different combustion model approaches, such as infinitely fast chemistry based unsteady flamelet and finite rate chemistry based EDC, in predicting the NOx formation in three piloted methane jet flames (Sandia D, E, and F). The EDC approach is able to predict the passive scalar quantities but shows over-prediction in the reactive scalar quantities and NO prediction, while the unsteady flamelet modeling is found to be essential in predicting the accurate formation of slow kinetic species like NOx. The inability of flamelet and EDC approach in capturing localized flame extinction is observed, which lead to an over-prediction of NOx at larger downstream locations. Further, the dominance of NOx formation pathways is investigated in all three flames.


title: Explainable Person Re-Identification with Attribute-guided Metric Distillation

abstract: Despite the great progress of person re-identification (ReID) with the adoption of Convolutional Neural Networks, current ReID models are opaque and only outputs a scalar distance between two persons. There are few methods providing users semantically understandable explanations for why two persons are the same one or not. In this paper, we propose a post-hoc method, named Attribute-guided Metric Distillation (AMD), to explain existing ReID models. This is the first method to explore attributes to answer: 1) what and where the attributes make two persons different, and 2) how much each attribute contributes to the difference. In AMD, we design a pluggable interpreter network for target models to generate quantitative contributions of attributes and visualize accurate attention maps of the most discriminative attributes. To achieve this goal, we propose a metric distillation loss by which the interpreter learns to decompose the distance of two persons into components of attributes with knowledge distilled from the target model. Moreover, we propose an attribute prior loss to make the interpreter generate attribute-guided attention maps and to eliminate biases caused by the imbalanced distribution of attributes. This loss can guide the interpreter to focus on the exclusive and discriminative attributes rather than the large-area but common attributes of two persons. Comprehensive experiments show that the interpreter can generate effective and intuitive explanations for varied models and generalize well under cross-domain settings. As a by-product, the accuracy of target models can be further improved with our interpreter.


title: Social Profit Optimization with Demand Response Management in Electricity Market: A Multi-timescale Leader-following Approach

abstract: In the electricity market, it is quite common that the market participants make "selfish" strategies to harvest the maximum profits for themselves, which may cause the social benefit loss and impair the sustainability of the society in the long term. Regarding this issue, in this work, we will discuss how the social profit can be improved through strategic demand response (DR) management. Specifically, we explore two interaction mechanisms in the market: Nash equilibrium (NE) and Stackelberg equilibrium (SE) among utility companies (UCs) and user-UC interactions, respectively. At the user side, each user determines the optimal energy-purchasing strategy to maximize its own profit. At the UC side, a governmental UC (g-UC) is considered, who aims to optimize the social profit of the market. Meanwhile, normal UCs play games to maximize their own profits. As a result, a basic leader-following problem among the UCs is formulated under the coordination of the independent system operator (ISO). Moreover, by using our proposed demand function amelioration (DFA) strategy, a multi-timescale leader-following problem is formulated. In this case, the maximal market efficiency can be achieved without changing the "selfish instinct" of normal UCs. In addition, by considering the local constraints for the UCs, two projection-based pricing algorithms are proposed for UCs, which can provide approximate optimal solutions for the resulting non-convex social profit optimization problems. The feasibility of the proposed algorithms is verified by using the concept of price of anarchy (PoA) in a multi-UC multi-user market model in the simulation.


title: Efficient Optimal Selection for Composited Advertising Creatives with Tree Structure

abstract: Ad creatives are one of the prominent mediums for online e-commerce advertisements. Ad creatives with enjoyable visual appearance may increase the click-through rate (CTR) of products. Ad creatives are typically handcrafted by advertisers and then delivered to the advertising platforms for advertisement. In recent years, advertising platforms are capable of instantly compositing ad creatives with arbitrarily designated elements of each ingredient, so advertisers are only required to provide basic materials. While facilitating the advertisers, a great number of potential ad creatives can be composited, making it difficult to accurately estimate CTR for them given limited real-time feedback. To this end, we propose an Adaptive and Efficient ad creative Selection (AES) framework based on a tree structure. The tree structure on compositing ingredients enables dynamic programming for efficient ad creative selection on the basis of CTR. Due to limited feedback, the CTR estimator is usually of high variance. Exploration techniques based on Thompson sampling are widely used for reducing variances of the CTR estimator, alleviating feedback sparsity. Based on the tree structure, Thompson sampling is adapted with dynamic programming, leading to efficient exploration for potential ad creatives with the largest CTR. We finally evaluate the proposed algorithm on the synthetic dataset and the real-world dataset. The results show that our approach can outperform competing baselines in terms of convergence rate and overall CTR.


title: Kernel Interpolation for Scalable Online Gaussian Processes

abstract: Gaussian processes (GPs) provide a gold standard for performance in online settings, such as sample-efficient control and black box optimization, where we need to update a posterior distribution as we acquire data in a sequential fashion. However, updating a GP posterior to accommodate even a single new observation after having observed $n$ points incurs at least $O(n)$ computations in the exact setting. We show how to use structured kernel interpolation to efficiently recycle computations for constant-time $O(1)$ online updates with respect to the number of points $n$, while retaining exact inference. We demonstrate the promise of our approach in a range of online regression and classification settings, Bayesian optimization, and active sampling to reduce error in malaria incidence forecasting. Code is available at https://github.com/wjmaddox/online_gp.


title: Anomalous fractional quantization in the kagomelike Heisenberg ladder: Emergence of the effective spin-1 chain

abstract: We study a Kagome-like spin-$1/2$ Heisenberg ladder with competing ferromagnetic (FM) and antiferromagnetic (AFM) exchange interactions. Using the density-matrix renormalization group based calculations, we obtain the ground state phase diagram as a function of the ratio between the FM and AFM exchange interactions. Five different phases exist. Three of them are spin polarized phases; an FM phase and two kinds of ferrimagnetic (FR) phases (referred to as FR1 and FR2 phases). The spontaneous magnetization per site is $m=1/2$, $1/3$, and $1/6$ in the FM, FR1, and FR2 phases, respectively. This can be understood from the fact that an effective spin-1 Heisenberg chain formed by the upper and lower leg spins has a three-step fractional quantization of the magnetization per site as $m=1$, $1/2$, and $0$. In particular, an anomalous "intermediate" state $m=1/2$ of the effective spin-1 chain with the reduced Hilbert space of a spin from $3$ to $2$ dimensional is highly unexpected in the context of conventional spin-1 physics. Thus, surprisingly, the effective spin-1 chain behaves like a spin-1/2 chain with SU(2) symmetry. The remaining two phases are spin-singlet phases with translational symmetry breaking in the presence of valence bond formations. One of them is octamer-siglet phase with a spontaneous octamerization long-range order of the system, and the other is period-4 phase characterized by the magnetic superstructure with a period of four structural unit cells. In these spin-singlet phases, we find the coexistence of valence bond structure and gapless chain. Although this may be emerged through the order-by-disorder mechanism, there can be few examples of such a coexistence.


title: Image-to-image Translation via Hierarchical Style Disentanglement

abstract: Recently, image-to-image translation has made significant progress in achieving both multi-label (\ie, translation conditioned on different labels) and multi-style (\ie, generation with diverse styles) tasks. However, due to the unexplored independence and exclusiveness in the labels, existing endeavors are defeated by involving uncontrolled manipulations to the translation results. In this paper, we propose Hierarchical Style Disentanglement (HiSD) to address this issue. Specifically, we organize the labels into a hierarchical tree structure, in which independent tags, exclusive attributes, and disentangled styles are allocated from top to bottom. Correspondingly, a new translation process is designed to adapt the above structure, in which the styles are identified for controllable translations. Both qualitative and quantitative results on the CelebA-HQ dataset verify the ability of the proposed HiSD. We hope our method will serve as a solid baseline and provide fresh insights with the hierarchically organized annotations for future research in image-to-image translation. The code has been released at https://github.com/imlixinyang/HiSD.


title: Ultracompact energy transfer in anapole-based metachains

abstract: Realization of electromagnetic energy confinement beyond the diffraction limit is of paramount importance for novel applications like nano-imaging, information processing, and energy harvest. Current approaches based on surface plasmon polaritons and photonic crystals are either intrinsically lossy or with low coupling efficiency. Herein, we successfully address these challenges by constructing an array of nonradiative anapoles that originate from the destructive far-field interference of electric and toroidal dipole modes. The proposed metachain can achieve ultracompact (1/13 of incident wavelength) and high-efficiency electromagnetic energy transfer without the coupler. We experimentally investigate the proposed metachain at mid-infrared and give the first near-field experimental evidence of anapole-based energy transfer, in which the spatial profile of anapole mode is also unambiguously identified at nanoscale. We further demonstrate the metachain is intrinsically lossless and scalable at infrared wavelengths, realizing a 90$^\circ$ bending loss down to 0.32 dB at the optical communication wavelength. The present scheme bridges the gap between the energy confinement and transfer of anapoles, and opens a new gate for more compactly integrated photonic and energy devices, which can operate in a broad spectral range.


title: Diffusion Probabilistic Models for 3D Point Cloud Generation

abstract: We present a probabilistic model for point cloud generation, which is fundamental for various 3D vision tasks such as shape completion, upsampling, synthesis and data augmentation. Inspired by the diffusion process in non-equilibrium thermodynamics, we view points in point clouds as particles in a thermodynamic system in contact with a heat bath, which diffuse from the original distribution to a noise distribution. Point cloud generation thus amounts to learning the reverse diffusion process that transforms the noise distribution to the distribution of a desired shape. Specifically, we propose to model the reverse diffusion process for point clouds as a Markov chain conditioned on certain shape latent. We derive the variational bound in closed form for training and provide implementations of the model. Experimental results demonstrate that our model achieves competitive performance in point cloud generation and auto-encoding. The code is available at \url{https://github.com/luost26/diffusion-point-cloud}.


title: Massive High-Redshift Quiescent Galaxies With JWST

abstract: Recent ground-based deep observations of the Universe have discovered large populations of massive quiescent galaxies at z~3-5. With the launch of the James Webb Space Telescope (JWST), the on-board NIRSpec instrument will provide continuous 0.6-5.3 $\mu$ m spectroscopic coverage of these galaxies. Here we show that NIRSpec/CLEAR spectroscopy is ideal to probe the completeness of photometrically selected massive quiescent galaxies such as the ones presented by Schreiber et al. (2018b). Using a subset of the Schreiber et al. (2018b) sample with deep Keck/MOSFIRE spectroscopy presented by Esdaile et al. (2020), we perform a suite of mock JWST/NIRSpec observations to determine optimal observing strategies to efficiently recover the star-formation histories (SFHs), element abundances, and kinematics of these massive quiescent galaxies. We find that at z~3, medium resolution G235M/FL170LP NIRSpec observations could recover element abundances at an accuracy of ~15%, which is comparable to local globular clusters. Mimicking ZFOURGE COSMOS photometry, we perform mock spectrophotometric fitting with Prospector to show that the overall shape of the SFHs of our mock galaxies can be recovered well, albeit with a dependency on the number of non-parametric SFH bins. We show that deep high-resolution G235H/FL170LP integral field spectroscopy with a S/N~7 per spaxel is required to constrain the rotational properties of our sample at >2$\sigma$ confidence. Thus, through optimal grism/filter choices, JWST/NIRSpec slit and integral field spectroscopy observations would provide tight constraints to galaxy evolution in the early Universe.


title: Limited-Trust in Social Network Games

abstract: We consider agents in a social network competing to be selected as partners in collaborative, mutually beneficial activities. We study this through a model in which an agent i can initiate a limited number k_i>0 of games and selects the ideal partners from its one-hop neighborhood. On the flip side it can accept as many games offered from its neighbors. Each game signifies a productive joint economic activity, and players attempt to maximize their individual utilities. Unsurprisingly, more trustworthy agents are more desirable as partners. Trustworthiness is measured by the game theoretic concept of Limited-Trust, which quantifies the maximum cost an agent is willing to incur in order to improve the net utility of all agents. Agents learn about their neighbors' trustworthiness through interactions and their behaviors evolve in response. Empirical trials performed on realistic social networks show that when given the option, many agents become highly trustworthy; most or all become highly trustworthy when knowledge of their neighbors' trustworthiness is based on past interactions rather than known a priori. This trustworthiness is not the result of altruism, instead agents are intrinsically motivated to become trustworthy partners by competition. Two insights are presented: first, trustworthy behavior drives an increase in the utility of all agents, where maintaining a relatively modest level of trustworthiness may easily improve net utility by as much as 14.5%. If only one agent exhibits modest trust among self-centered ones, it can increase its average utility by up to 25% in certain cases! Second, and counter-intuitively, when partnership opportunities are abundant agents become less trustworthy.


title: Tune-In: Training Under Negative Environments with Interference for Attention Networks Simulating Cocktail Party Effect

abstract: We study the cocktail party problem and propose a novel attention network called Tune-In, abbreviated for training under negative environments with interference. It firstly learns two separate spaces of speaker-knowledge and speech-stimuli based on a shared feature space, where a new block structure is designed as the building block for all spaces, and then cooperatively solves different tasks. Between the two spaces, information is cast towards each other via a novel cross- and dual-attention mechanism, mimicking the bottom-up and top-down processes of a human's cocktail party effect. It turns out that substantially discriminative and generalizable speaker representations can be learnt in severely interfered conditions via our self-supervised training. The experimental results verify this seeming paradox. The learnt speaker embedding has superior discriminative power than a standard speaker verification method; meanwhile, Tune-In achieves remarkably better speech separation performances in terms of SI-SNRi and SDRi consistently in all test modes, and especially at lower memory and computational consumption, than state-of-the-art benchmark systems.


title: Neural evolution structure generation: High Entropy Alloys

abstract: We propose a method of neural evolution structures (NESs) combining artificial neural networks (ANNs) and evolutionary algorithms (EAs) to generate High Entropy Alloys (HEAs) structures. Our inverse design approach is based on pair distribution functions and atomic properties and allows one to train a model on smaller unit cells and then generate a larger cell. With a speed-up factor of approximately 1000 with respect to the SQSs, the NESs dramatically reduces computational costs and time, making possible the generation of very large structures (over 40,000 atoms) in few hours. Additionally, unlike the SQSs, the same model can be used to generate multiple structures with the same fractional composition.


title: Audio-Visual Speech Separation Using Cross-Modal Correspondence Loss

abstract: We present an audio-visual speech separation learning method that considers the correspondence between the separated signals and the visual signals to reflect the speech characteristics during training. Audio-visual speech separation is a technique to estimate the individual speech signals from a mixture using the visual signals of the speakers. Conventional studies on audio-visual speech separation mainly train the separation model on the audio-only loss, which reflects the distance between the source signals and the separated signals. However, conventional losses do not reflect the characteristics of the speech signals, including the speaker's characteristics and phonetic information, which leads to distortion or remaining noise. To address this problem, we propose the cross-modal correspondence (CMC) loss, which is based on the cooccurrence of the speech signal and the visual signal. Since the visual signal is not affected by background noise and contains speaker and phonetic information, using the CMC loss enables the audio-visual speech separation model to remove noise while preserving the speech characteristics. Experimental results demonstrate that the proposed method learns the cooccurrence on the basis of CMC loss, which improves separation performance.


title: NavTuner: Learning a Scene-Sensitive Family of Navigation Policies

abstract: The advent of deep learning has inspired research into end-to-end learning for a variety of problem domains in robotics. For navigation, the resulting methods may not have the generalization properties desired let alone match the performance of traditional methods. Instead of learning a navigation policy, we explore learning an adaptive policy in the parameter space of an existing navigation module. Having adaptive parameters provides the navigation module with a family of policies that can be dynamically reconfigured based on the local scene structure, and addresses the common assertion in machine learning that engineered solutions are inflexible. Of the methods tested, reinforcement learning (RL) is shown to provide a significant performance boost to a modern navigation method through reduced sensitivity of its success rate to environmental clutter. The outcomes indicate that RL as a meta-policy learner, or dynamic parameter tuner, effectively robustifies algorithms sensitive to external, measurable nuisance factors.


title: Three-dimensional supersonic flows of Euler-Poisson system for potential flow

abstract: We prove the unique existence of supersonic solutions of the Euler- Poisson system for potential flow in a three-dimensional rectangular cylinder when prescribing the velocity and the strength of electric field at the entrance. Overall, the main framework is similar to [1], but there are several technical differences to be taken care of vary carefully. And, it is our main goal to treat all the technical differences occurring when one considers a three dimensional supersonic solution of the steady Euler-Poisson system.