title: Mapping the Buried Cable by Ground Penetrating Radar and Gaussian-Process Regression

abstract: With the rapid expansion of urban areas and the increasingly use of electricity, the need for locating buried cables is becoming urgent. In this paper, a noval method to locate underground cables based on Ground Penetrating Radar (GPR) and Gaussian-process regression is proposed. Firstly, the coordinate system of the detected area is conducted, and the input and output of locating buried cables are determined. The GPR is moved along the established parallel detection lines, and the hyperbolic signatures generated by buried cables are identified and fitted, thus the positions and depths of some points on the cable could be derived. On the basis of the established coordinate system and the derived points on the cable, the clustering method and cable fitting algorithm based on Gaussian-process regression are proposed to find the most likely locations of the underground cables. Furthermore, the confidence intervals of the cable's locations are also obtained. Both the position and depth noises are taken into account in our method, ensuring the robustness and feasibility in different environments and equipments. Experiments on real-world datasets are conducted, and the obtained results demonstrate the effectiveness of the proposed method.


title: The Environments of CO Cores and Star Formation in the Dwarf Irregular Galaxy WLM

abstract: The low metallicities of dwarf irregular galaxies (dIrr) greatly influence the formation and structure of molecular clouds. These clouds, which consist primarily of H$_2$, are typically traced by CO, but low metallicity galaxies are found to have little CO despite ongoing star formation. In order to probe the conditions necessary for CO core formation in dwarf galaxies, we have used the catalog of Rubio et al. (2022, in preparation) for CO cores in WLM, a Local Group dwarf with an oxygen abundance that is 13% of solar. Here we aim to characterize the galactic environments in which these 57 CO cores formed. We grouped the cores together based on proximity to each other and strong FUV emission, examining properties of the star forming region enveloping the cores and the surrounding environment where the cores formed. We find that high HI surface density does not necessarily correspond to higher total CO mass, but regions with higher CO mass have higher HI surface densities. We also find the cores in star forming regions spanning a wide range of ages show no correlation between age and CO core mass, suggesting that the small size of the cores is not due to fragmentation of the clouds with age. The presence of CO cores in a variety of different local environments, along with the similar properties between star forming regions with and without CO cores, leads us to conclude that there are no obvious environmental characteristics that drive the formation of these CO cores.


title: Skeleton-stabilized divergence-conforming B-spline discretizations for highly advective incompressible flow problems

abstract: We consider a stabilization method for divergence-conforming B-spline discretizations of the incompressible Navier--Stokes problem wherein jumps in high-order normal derivatives of the velocity field are penalized across interior mesh facets. We prove that this method is pressure robust, consistent, and energy stable, and we show how to select the stabilization parameter appearing in the method so that excessive numerical dissipation is avoided in both the cross-wind direction and in the diffusion-dominated regime. We examine the efficacy of the method using a suite of numerical experiments, and we find the method yields optimal $\textbf{L}^2$ and $\textbf{H}^1$ convergence rates for the velocity field, eliminates spurious small-scale structures that pollute Galerkin approximations, and is effective as an Implicit Large Eddy Simulation (ILES) methodology.


title: Structural sensitivity in the functional responses of predator-prey models

abstract: In mathematical modeling, several different functional forms can often be used to fit a data set equally well, especially if the data is sparse. In such cases, these mathematically different but similar looking functional forms are typically considered interchangeable. Recent work, however, shows that similar functional responses may nonetheless result in significantly different bifurcation points for the Rosenzweig-MacArthur predator-prey system. Since the bifurcation behaviours include destabilising oscillations, predicting the occurrence of such behaviours is clearly important. Ecologically, different bifurcation behaviours mean that different predictions may be obtained from the models. These predictions can range from stable coexistence to the extinction of both species, so obtaining more accurate predictions is also clearly important for conservationists. Mathematically, this difference in bifurcation structure given similar functional responses is called structural sensitivity. We extend the existing work to find that the Leslie-Gower-May predator-prey system is also structurally sensitive to the functional response. Using the Rosenzweig-MacArthur and Leslie-Gower-May models, we then aim to determine if there is some way to obtain a functional description of data such that our model is not structurally sensitive. We first add stochasticity to the functional responses and find that better similarity of the resulting bifurcation structures is achieved. Then, we analyze the functional responses using two different methods to determine which part of each function contributes most to the observed bifurcation behaviour. We find that prey densities around the coexistence steady state are most important in defining the functional response. Lastly, we propose a procedure for ecologists and mathematical modelers to increase the accuracy of model predictions in predator-prey systems.


title: A computational study of steady and stagnating positive streamers in N2-O2 mixtures

abstract: In this paper, we address two main topics: steady propagation fields for positive streamers in air and streamer deceleration in fields below the steady propagation field. We generate constant-velocity positive streamers in air with an axisymmetric fluid model, by initially adjusting the applied voltage based on the streamer velocity. After an initial transient, we observe steady propagation for velocities of $3\times10^4$ m/s to $1.2\times10^5$ m/s, during which streamer properties and the background field do not change. This propagation mode is not fully stable, in the sense that a small change in streamer properties or background field eventually leads to acceleration or deceleration. An important finding is that faster streamers are able to propagate in significantly lower background fields than slower ones, indicating that there is no unique stability field. We relate the streamer radius, velocity, maximal electric field and background electric field to a characteristic time scale for the loss of conductivity. This relation is qualitatively confirmed by studying streamers in N2-O2 mixtures with less oxygen than air. In such mixtures, steady streamers require lower background fields, due to a reduction in the attachment and recombination rates. We also study the deceleration of streamers, which is important to predict how far they can propagate in a low field. Stagnating streamers are simulated by applying a constant applied voltage. We show how the properties of these streamers relate to the steady cases, and present a phenomenological model with fitted coefficients that describes the evolution of the velocity and radius. Finally, we compare the lengths of the stagnated streamers with predictions based on the conventional stability field.


title: Learning How to Translate North Korean through South Korean

abstract: South and North Korea both use the Korean language. However, Korean NLP research has focused on South Korean only, and existing NLP systems of the Korean language, such as neural machine translation (NMT) models, cannot properly handle North Korean inputs. Training a model using North Korean data is the most straightforward approach to solving this problem, but there is insufficient data to train NMT models. In this study, we create data for North Korean NMT models using a comparable corpus. First, we manually create evaluation data for automatic alignment and machine translation. Then, we investigate automatic alignment methods suitable for North Korean. Finally, we verify that a model trained by North Korean bilingual data without human annotation can significantly boost North Korean translation accuracy compared to existing South Korean models in zero-shot settings.


title: Controlling Directions Orthogonal to a Classifier

abstract: We propose to identify directions invariant to a given classifier so that these directions can be controlled in tasks such as style transfer. While orthogonal decomposition is directly identifiable when the given classifier is linear, we formally define a notion of orthogonality in the non-linear case. We also provide a surprisingly simple method for constructing the orthogonal classifier (a classifier utilizing directions other than those of the given classifier). Empirically, we present three use cases where controlling orthogonal variation is important: style transfer, domain adaptation, and fairness. The orthogonal classifier enables desired style transfer when domains vary in multiple aspects, improves domain adaptation with label shifts and mitigates the unfairness as a predictor. The code is available at http://github.com/Newbeeer/orthogonal_classifier


title: To what extent should we trust AI models when they extrapolate?

abstract: Many applications affecting human lives rely on models that have come to be known under the umbrella of machine learning and artificial intelligence. These AI models are usually complicated mathematical functions that map from an input space to an output space. Stakeholders are interested to know the rationales behind models' decisions and functional behavior. We study this functional behavior in relation to the data used to create the models. On this topic, scholars have often assumed that models do not extrapolate, i.e., they learn from their training samples and process new input by interpolation. This assumption is questionable: we show that models extrapolate frequently; the extent of extrapolation varies and can be socially consequential. We demonstrate that extrapolation happens for a substantial portion of datasets more than one would consider reasonable. How can we trust models if we do not know whether they are extrapolating? Given a model trained to recommend clinical procedures for patients, can we trust the recommendation when the model considers a patient older or younger than all the samples in the training set? If the training set is mostly Whites, to what extent can we trust its recommendations about Black and Hispanic patients? Which dimension (race, gender, or age) does extrapolation happen? Even if a model is trained on people of all races, it still may extrapolate in significant ways related to race. The leading question is, to what extent can we trust AI models when they process inputs that fall outside their training set? This paper investigates several social applications of AI, showing how models extrapolate without notice. We also look at different sub-spaces of extrapolation for specific individuals subject to AI models and report how these extrapolations can be interpreted, not mathematically, but from a humanistic point of view.


title: Broadband Squeezed Microwaves and Amplification with a Josephson Traveling-Wave Parametric Amplifier

abstract: Squeezing of the electromagnetic vacuum is an essential metrological technique used to reduce quantum noise in applications spanning gravitational wave detection, biological microscopy, and quantum information science. In superconducting circuits, the resonator-based Josephson-junction parametric amplifiers conventionally used to generate squeezed microwaves are constrained by a narrow bandwidth and low dynamic range. In this work, we develop a dual-pump, broadband Josephson traveling-wave parametric amplifier that combines a phase-sensitive extinction ratio of 56 dB with single-mode squeezing on par with the best resonator-based squeezers. We also demonstrate two-mode squeezing at microwave frequencies with bandwidth in the gigahertz range that is almost two orders of magnitude wider than that of contemporary resonator-based squeezers. Our amplifier is capable of simultaneously creating entangled microwave photon pairs with large frequency separation, with potential applications including high-fidelity qubit readout, quantum illumination and teleportation.


title: An upper bound on the generic degree of the generalized Verschiebung for rank two stable bundles

abstract: In the present paper, we give an upper bound for the generic degree of the generalized Verschiebung between the moduli spaces of rank two stable bundles with trivial determinant.


title: Linearity of Free Resolutions of Monomial Ideals

abstract: We study monomial ideals with linear presentation or partially linear resolution. We give combinatorial characterizations of linear presentation for square-free ideals of degree 3, and for primary ideals whose resolutions are linear except for the last step (the "almost linear" case). We also give sharp bounds on Castelnuovo-Mumford regularity and numbers of generators in some cases. It is a basic observation that linearity properties are inherited by the restriction of an ideal to a subset of variables, and we study when the converse holds. We construct fractal examples of almost linear primary ideals with relatively few generators related to the Sierpi\'nski triangle. Our results also lead to classes of highly connected simplicial complexes $\Delta$ that can not be extended to the complete $\dim \Delta$-skeleton of the simplex on the same variables by shelling.


title: Properties of the Non-Autonomous Lattice Sine-Gordon Equation: Consistency around a Broken Cube Property

abstract: The lattice sine-Gordon equation is an integrable partial difference equation on ${\mathbb Z}^2$, which approaches the sine-Gordon equation in a continuum limit. In this paper, we show that the non-autonomous lattice sine-Gordon equation has the consistency around a broken cube property as well as its autonomous version. Moreover, we construct two new Lax pairs of the non-autonomous case by using the consistency property.


title: Interplay between magnetism and band topology in Kagome magnets $R$Mn$_6$Sn$_6$

abstract: Kagome-lattice magnets $R$Mn$_6$Sn$_6$ recently emerged as a new platform to exploit the interplay between magnetism and topological electronic states. Some of the most exciting features of this family are the dramatic dependence of the easy magnetization direction on the rare-earth specie and the kagome geometry of the Mn planes that in principle can generate flat bands and Dirac points; gapping of the Dirac points by spin-orbit coupling has been suggested recently to be responsible for the observed anomalous Hall response in the member TbMn$_6$Sn$_6$. In this paper, we address both issues with ab initio calculations. We have discovered the significant role played by higher-order crystal-field parameters and rare-earth magnetic anisotropy constants in these systems. We demonstrate that the microscopic origin of rare-earth anisotropy can also be quantified and understood at various levels: ab initio, phenomenological, and analytical. In particular, using a simple and physically transparent analytical model, we explain, with full quantitative agreement, the evolution of anisotropy across the series. We analyze the topological properties of Mn-dominated bands and demonstrate how they emerge from the multiorbital planar kagome model. We further show that the most pronounced quasi-2D dispersion are too far removed from the Fermi level, and therefore cannot explain the observed quasi-2D anomalous Hall effect. By employing ab initio many-body approaches, we demonstrate that the exchange-correlation effects for itinerant Mn-$d$ electrons do not significantly alter the obtained electronic and magnetic structure. Therefore, we conclude that, contrary to previous claims, the most pronounced 2D kagome-derived topological band features bear little relevance to transport in $R$Mn$_6$Sn$_6$, albeit they may possibly be brought to focus by electron or hole doping.


title: Differential modules and dormant opers of higher level

abstract: In the first half of the present paper, we study higher-level generalizations of differential modules in positive characteristic. These objects may be regarded as ring-theoretic counterparts of vector bundles on a curve equipped with an action of the ring of (logarithmic) differential operators of finite level introduced by P. Berthelot (and C. Montagnon). The existence assertion for a cyclic vector of a differential module is generalized to higher level under mild conditions. In the second half, we introduce (dormant) opers of level $N > 0$ on a pointed smooth curve whose structure group is either $\mathrm{GL}_n$ or $\mathrm{PGL}_n$. Some of the results on higher-level differential modules are applied to prove a duality theorem between dormant $\mathrm{PGL}_n$-opers of level $N$ and dormant $\mathrm{PGL}_{p^N-n}$-opers of level $N$. Finally, in the case where the underlying curve is a $3$-pointed projective line, we establish a bijective correspondence between dormant $\mathrm{PGL}_2$-opers of level $N$ and certain tamely ramified coverings.


title: A Comprehensive Toolbox to Facilitate Quantitative Decision Science in Drug Development: A web-based R shiny application GOahead

abstract: Decision-making is critical at each stage of drug development and making informed and transparent Go/No-Go decisions require a sound quantitative decision framework. We designed and implemented GOahead, a comprehensive web-based tool to improve how statisticians and collaborators could prospectively plan and implement the selected Go/No-Go decision approach in real-time. In the paper, we conducted a comprehensive overview of dual-criterion and confidence interval-based approaches to enable quantitative decision-making. illustrative examples are demonstrated for single and two arms designs in both Bayesian and frequentist frameworks, multiple arms design with MCP-MOD is also demonstrated. GOahead can be found on shinyapps server.


title: Additive actions on hyperquadrics of corank two

abstract: For a projective variety $X$ in $\mathbb{P}^{m}$ of dimension $n$, an additive action on $X$ is an effective action of $\mathbb{G}_{a}^{n}$ on $\mathbb{P}^{m}$ such that $X$ is $\mathbb{G}_{a}^{n}$-invariant and the induced action on $X$ has an open orbit. Arzhantsev and Popovskiy have classified additive actions on hyperquadrics of corank 0 or 1. In this paper, we give the classification of additive actions on hyperquadrics of corank 2 whose singularities are not fixed by the $\mathbb{G}_{a}^{n}$-action.


title: Temperature Dependence of Magnetocrystalline Anisotropy in Itinerant Ferromagnets

abstract: We theoretically investigated magnetocrystalline anisotropy (MA) at a finite temperature $T$ in ferromagnetic metals. Assuming a Rashba-type ferromagnet with uniaxial MA, we defined the MA constants $K_\mathrm{u}(T)$ derived from several different concepts. Our purpose was to examine the equality between them and to confirm a power law between $K_\mathrm{u}(T)$ and magnetization $M(T)$ in the form of $K_\mathrm{u}(T)/K_\mathrm{u}(0)=[M(T)/M(0)]^\alpha$. We demonstrate that $\alpha$ equals 2 in the itinerant-electron limit and increases with the localized feature of electrons passing through $\alpha=3$, predicted for the single-ion MA in spin models.


title: Simultaneous measurement of the exchange parameter and saturation magnetization using propagating spin waves

abstract: The exchange interaction in ferromagnetic ultra-thin films is a critical parameter in magnetization-based storage and logic devices, yet the accurate measurement of it remains a challenge. While a variety of approaches are currently used to determine the exchange parameter, each has its limitations, and good agreement among them has not been achieved. To date, neutron scattering, magnetometry, Brillouin light scattering, spin-torque ferromagnetic resonance spectroscopy, and Kerr microscopy have all been used to determine the exchange parameter. Here we present a novel method that exploits the wavevector selectivity of Brillouin light scattering to measure the spin wave dispersion in both the backward volume and Damon-Eshbach orientations. The exchange, saturation magnetization, and magnetic thickness are then determined by a simultaneous fit of both dispersion branches with general spin wave theory without any prior knowledge of the thickness of a magnetic "dead layer". In this work, we demonstrate the strength of this technique for ultrathin metallic films, typical of those commonly used in industrial applications for magnetic random-access memory.


title: Clustered Vehicular Federated Learning: Process and Optimization

abstract: Federated Learning (FL) is expected to play a prominent role for privacy-preserving machine learning (ML) in autonomous vehicles. FL involves the collaborative training of a single ML model among edge devices on their distributed datasets while keeping data locally. While FL requires less communication compared to classical distributed learning, it remains hard to scale for large models. In vehicular networks, FL must be adapted to the limited communication resources, the mobility of the edge nodes, and the statistical heterogeneity of data distributions. Indeed, a judicious utilization of the communication resources alongside new perceptive learning-oriented methods are vital. To this end, we propose a new architecture for vehicular FL and corresponding learning and scheduling processes. The architecture utilizes vehicular-to-vehicular(V2V) resources to bypass the communication bottleneck where clusters of vehicles train models simultaneously and only the aggregate of each cluster is sent to the multi-access edge (MEC) server. The cluster formation is adapted for single and multi-task learning, and takes into account both communication and learning aspects. We show through simulations that the proposed process is capable of improving the learning accuracy in several non-independent and-identically-distributed (non-i.i.d) and unbalanced datasets distributions, under mobility constraints, in comparison to standard FL.


title: Big Flip Graphs and Their Automorphism Groups

abstract: In this paper, we study the relationship between the mapping class group of an infinite-type surface and the simultaneous flip graph, a variant of the flip graph for infinite-type surfaces defined by Fossas and Parlier. We show that the extended mapping class group is isomorphic to a proper subgroup of the automorphism group of the flip graph, unlike in the finite-type case. This shows that Ivanov's metaconjecture, which states that any "sufficiently rich" object associated to a finite-type surface has the extended mapping class group as its automorphism group, does not extend to simultaneous flip graphs of infinite-type surfaces.


title: On the category of structure species

abstract: The purpose of the present paper is to make a mathematical study of the differences and relations among possible structures inherent in an object, as well as of the whole structure constituted by them (i.e., the structure of structures), against the background of the structuralism by Claude L\'{e}vi-Strauss and others. Our discussion focuses on Blanchard's categorical reformulation of the notion of structure species introduced originally by Bourbaki. The main result of the present paper asserts that a category can be reconstructed, up to a certain slight indeterminacy, from the category of structure species on it. This result is partially motivated by various reconstruction theorems that have been shown in the context of anabelian geometry.


title: On a conjecture of Graham on the p-divisibility of central binomial coefficients

abstract: We show that for every $r \geq 1$, and all $r$ distinct (sufficiently large) primes $p_1,..., p_r > p_0(r)$, there exist infinitely many integers $n$ such that ${2n \choose n}$ is divisible by these primes to only low multiplicity. From a theorem of Kummer, an upper bound for the number of times that a prime $p_j$ can divide ${2n \choose n}$ is $1+\log n / \log p_j$; and our theorem shows that for every $\varepsilon > 0$, $r \geq 1$, and any sufficiently large primes $p_1,...,p_r > p_0(\varepsilon,r)$, we can find integers $n$ where for $j=1,...,r$, $p_j$ divides ${2n \choose n}$ with multiplicity at most $\varepsilon \log n/\log p_j$. We connect this result to a famous conjecture by R. L. Graham on whether there are infinitely many integers $n$ such that ${2n \choose n}$ is coprime to $105$.


title: Wireless IoT Energy Sharing Platform

abstract: Wireless energy sharing is a novel convenient alternative to charge IoT devices. In this demo paper, we present a peer-to-peer wireless energy sharing platform. The platform enables users to exchange energy wirelessly with nearby IoT devices. The energy sharing platform allows IoT users to send and receive energy wirelessly. The platform consists of (i) a mobile application that monitors and synchronizes the energy transfer among two IoT devices and (ii) and a backend to register energy providers and consumers and store their energy transfer transactions. The eveloped framework allows the collection of a real wireless energy sharing dataset. A set of preliminary experiments has been conducted on the collected dataset to analyze and demonstrate the behavior of the current wireless energy sharing technology.


title: Clar's goblet on graphene: field modulated charge transfer in a hydrocarbon heterostructure

abstract: In certain configurations, the aromatic properties of benzene ring structured molecules allow for unpaired, reactive valence electrons (known as radicals). Clar's goblets are such molecules. With an even number of unpaired radicals, these nanographenes are topologically frustrated hydrocarbons in which pi-bonding network and topology of edges give rise to the magnetism. Clar's goblets are therefore valued as prospective qubits provided they can be modulated between magnetic states. Using first principles DFT, we demonstrate the effects of adsorption on both molecule and substrate in a graphene-Clar's goblet heterostructure. We look at the energy difference bewteen FM and AFM states of the system and discuss underlying physical and chemical mechanisms in reference to the highest occupied molecular orbital (HOMO) and second HOMO (HOMO-1). We find that the HOMO of the molecule in the FM state is right at the Fermi surface, which leads to the hybridization between molecular state and the graphene state near the Dirac point. Furthermore, we investigate qualitative changes in charge realignment and magnetic state under variable electric field. Transitions from FM to AFM and back to FM states are observed.


title: CP-Violating 2HDMs Emerging from 3-3-1 Models

abstract: We investigate CP violating 2 Higgs doublet models as an effective theory emerging from models with an $SU(3)_L \otimes U(1)_X$ gauge symmetry. Because of the extension of the electroweak symmetry, a characteristic structure of Yukawa interactions appears with new CP violating phases at the electroweak scale. In this scenario, the charged Higgs boson loop provides dominant and sizable contributions to the neutron electric dipole moment (nEDM) at one-loop level. We find that the prediction of the nEDM can be slightly smaller than the current upper limit, ${\cal O}(10^{-26})\,e\,\text{cm}$, with the mass of the charged Higgs boson and new CP violating phases to be a few hundred GeV and $\mathcal{O}(1)$, respectively, under the constraints from the meson mixings, the $B \to X_s \gamma$ decay and current LHC data.


title: Hierarchical Visual Interface for Lecture Video Retrieval and Summarization

abstract: With the emergence of large-scale open online courses and online academic conferences, it has become increasingly feasible and convenient to access online educational resources. However, it is time consuming and challenging to effectively retrieve and present numerous lecture videos for common users. In this work, we propose a hierarchical visual interface for retrieving and summarizing lecture videos. Users can utilize the proposed interface to effectively explore the required video information through the results of the video summary generation in different layers. We retrieve the input keywords with the corresponding video layer with timestamps, a frame layer with slides, and the poster layer with summarization of the lecture videos. We verified the proposed interface with our user study by comparing it with other conventional interfaces. The results from our user study confirmed that the proposed interface can achieve high retrieval accuracy and good user experience.see video here https://www.youtube.com/watch?v=zrnejwsOVpc .


title: Revisiting RCAN: Improved Training for Image Super-Resolution

abstract: Image super-resolution (SR) is a fast-moving field with novel architectures attracting the spotlight. However, most SR models were optimized with dated training strategies. In this work, we revisit the popular RCAN model and examine the effect of different training options in SR. Surprisingly (or perhaps as expected), we show that RCAN can outperform or match nearly all the CNN-based SR architectures published after RCAN on standard benchmarks with a proper training strategy and minimal architecture change. Besides, although RCAN is a very large SR architecture with more than four hundred convolutional layers, we draw a notable conclusion that underfitting is still the main problem restricting the model capability instead of overfitting. We observe supportive evidence that increasing training iterations clearly improves the model performance while applying regularization techniques generally degrades the predictions. We denote our simply revised RCAN as RCAN-it and recommend practitioners to use it as baselines for future research. Code is publicly available at https://github.com/zudi-lin/rcan-it.


title: Fluid and hybrid simulations of the ionization instabilities in Hall thruster

abstract: Low-frequency axial oscillations (5-50 kHz) stand out as a pervasive feature observed in many types of Hall thrusters. While it is widely recognized that the ionization effects play the central role in this mode, as manifested via the large scale oscillations of neutral and plasma density, the exact mechanism(s) of the instabilities remain unclear. To gain further insights into the physics of the breathing mode and evaluate the role of kinetic effects, a one-dimensional time-dependent full nonlinear low-frequency model describing neutral atoms, ions, and electrons, is developed in full fluid formulation and compared to the hybrid model in which the ions and neutrals are kinetic. Both models are quasineutral and share the same electron fluid equations that include the electron diffusion, mobility across the magnetic field, and the electron energy evolution. The ionization models are also similar in both approaches. The predictions of fluid and hybrid simulations are compared for different test cases. Two main regimes are identified in both models: one with pure low-frequency behaviour and the other one, where the low-frequency oscillations coexist with higher frequency oscillations (with the characteristic time scale of the ion channel flyby time, 100-200 kHz). The other test case demonstrate the effect of a finite temperature of injected atoms which is shown to have a substantial effect on the oscillation amplitude.


title: Network slicing for vehicular communications: a multi-agent deep reinforcement learning approach

abstract: This paper studies the multi-agent resource allocation problem in vehicular networks using non-orthogonal multiple access (NOMA) and network slicing. To ensure heterogeneous service requirements for different vehicles, we propose a network slicing architecture. We focus on a non-cellular network scenario where vehicles communicate by the broadcast approach via the direct device-to-device interface. In such a vehicular network, resource allocation among vehicles is very difficult, mainly due to (i) the rapid variation of wireless channels among highly mobile vehicles and (ii) the lack of a central coordination point. Thus, the possibility of acquiring instantaneous channel state information to perform centralized resource allocation is precluded. The resource allocation problem considered is therefore very complex. It includes not only the usual spectrum and power allocation, but also coverage selection (which target vehicles to broadcast to) and packet selection (which network slice to use). This problem must be solved jointly since selected packets can be overlaid using NOMA and therefore spectrum and power must be carefully allocated for better vehicle coverage. To do so, we provide a optimization approach and study the NP-hardness of the problem. Then, we model the problem using multi-agent Markov decision process. Finally, we use a deep reinforcement learning (DRL) approach to solve the problem. The proposed DRL algorithm is practical because it can be implemented in an online and distributed manner. We show that our approach is robust and efficient when faced with different variations of the network parameters and compared to centralized benchmarks.


title: A block triangular preconditioner for a class of three-by-three block saddle point problems

abstract: This paper deals with solving a class of three-by-three block saddle point problems. The systems are solved by preconditioning techniques. Based on an iterative method, we construct a block upper triangular preconditioner. The convergence of the presented method is studied in details. Finally, some numerical experiments are given to demonstrate the superiority of the proposed preconditioner over some existing ones.


title: Perverse-Hodge complexes for Lagrangian fibrations

abstract: Perverse-Hodge complexes are objects in the derived category of coherent sheaves obtained from Hodge modules associated with Saito's decomposition theorem. We study perverse-Hodge complexes for Lagrangian fibrations and propose a symmetry between them. This conjectural symmetry categorifies the "Perverse = Hodge" identity of the authors and specializes to Matsushita's theorem on the higher direct images of the structure sheaf. We verify our conjecture in several cases by making connections with variations of Hodge structures, Hilbert schemes, and Looijenga-Lunts-Verbitsky Lie algebras.


title: Interactive 3D Character Modeling from 2D Orthogonal Drawings with Annotations

abstract: We propose an interactive 3D character modeling approach from orthographic drawings (e.g., front and side views) based on 2D-space annotations. First, the system builds partial correspondences between the input drawings and generates a base mesh with sweeping splines according to edge information in 2D images. Next, users annotates the desired parts on the input drawings (e.g., the eyes and mouth) by using two type of strokes, called addition and erosion, and the system re-optimizes the shape of the base mesh. By repeating the 2D-space operations (i.e., revising and modifying the annotations), users can design a desired character model. To validate the efficiency and quality of our system, we verified the generated results with state-of-the-art methods.


title: Time-varying microwave photonic filter for arbitrary waveform signal-to-noise ratio improvement

abstract: A time-varying microwave photonic filter (TV-MPF) based on stimulated Brillouin scattering (SBS) is proposed and utilized to suppress the in-band noise of broadband arbitrary microwave waveforms, thereby improving the signal-to-noise ratio (SNR). The filter-controlling signal is designed according to the signal to be filtered and drives the TV-MPF so that the passband of the filter is always aligned with the frequencies of the signal to be filtered. By continuously tracking the signal spectral component, the TV-MPF only retains the spectral components of the signal and filters out the noise other than the spectral component of the signal at the current time, so as to improve the in-band SNR of the signal to be filtered. An experiment is performed. A variety of signals with different formats and in-band SNRs are used to test the noise suppression capability of the TV-MPF, and the waveform mean-square error is calculated to quantify the improvement of the signal, demonstrating the excellent adaptability of the proposed TV-MPF to different kinds of signals.


title: Gravity or turbulence V: Star forming regions undergoing violent relaxation

abstract: Using numerical simulations of the formation and evolution of stellar clusters within molecular clouds, we show that the stars in clusters formed within collapsing molecular cloud clumps exhibit a constant velocity dispersion regardless of their mass, as expected in a violent relaxation processes. In contrast, clusters formed in turbulence-dominated environments exhibit an {\it inverse} mass segregated velocity dispersion, where massive stars exhibit larger velocity dispersions than low-mass cores, consistent with massive stars formed in massive clumps, which in turn, are formed through strong shocks. We furthermore use Gaia EDR3 to show that the stars in the Orion Nebula Cluster exhibit a constant velocity dispersion as a function of mass, suggesting that it has been formed by collapse within one free-fall time of its parental cloud, rather than in a turbulence-dominated environment during many free-fall times of a supported cloud. Additionally, we have addressed several of the criticisms of models of collapsing star forming regions: namely, the age spread of the ONC, the comparison of the ages of the stars to the free-fall time of the gas that formed it, the star formation efficiency, and the mass densities of clouds vs the mass densities of stellar clusters, showing that observational and numerical data are consistent with clusters forming in clouds undergoing a process of global, hierarchical and chaotic collapse, rather than been supported by turbulence.


title: Sketch-based 3D Shape Modeling from Sparse Point Clouds

abstract: 3D modeling based on point clouds is an efficient way to reconstruct and create detailed 3D content. However, the geometric procedure may lose accuracy due to high redundancy and the absence of an explicit structure. In this work, we propose a human-in-the-loop sketch-based point cloud reconstruction framework to leverage users cognitive abilities in geometry extraction. We present an interactive drawing interface for 3D model creation from point cloud data with the help of user sketches. We adopt an optimization method in which the user can continuously edit the contours extracted from the obtained 3D model and retrieve the model iteratively. Finally, we verify the proposed user interface for modeling from sparse point clouds. see video here https://www.youtube.com/watch?v=0H19NyXDRJE .


title: Rotational modulation of spectroscopic Zeeman signatures in low-mass stars

abstract: Accurate tracers of the stellar magnetic field and rotation are cornerstones for the study of M dwarfs and for reliable detection and characterization of their exoplanetary companions. Such measurements are particularly challenging for old, slowly rotating, fully convective M dwarfs. To explore the use of new activity and rotation tracers, we examined multi-year near-infrared spectroscopic monitoring of two such stars -- GJ 699 (Barnard's Star) and Teegarden's Star -- carried out with Habitable Zone Planet Finder spectrograph. We detected periodic variations in absorption line widths across the stellar spectrum with higher amplitudes towards longer wavelengths. We also detected similar variations in the strength and width of the 12435.67 Angstrom neutral potassium (K I) line, a known tracer of the photospheric magnetic field. Attributing these variations to rotational modulation, we confirm the known $145\pm15$ d rotation period of GJ 699, and measure the rotation period of Teegarden's Star to be $99.6\pm1.4$ d. Based on simulations of the K I line and the wavelength-dependence of the line width signal, we argue that the observed signals are consistent with varying photospheric magnetic fields and the associated Zeeman effect. These results highlight the value of detailed line profile measurements in the near-infrared for diagnosing stellar magnetic field variability. Such measurements may be pivotal for disentangling activity and exoplanet-related signals in spectroscopic monitoring of old, low-mass stars.


title: High throughput data-driven design of laser crystallized 2D MoS2 chemical sensors

abstract: High throughput characterization and processing techniques are becoming increasingly necessary to navigate multivariable, data-driven design challenges for sensors and electronic devices. For two-dimensional materials, device performance is highly dependent upon a vast array of material properties including number of layers, lattice strain, carrier concentration, defect density, and grain structure. In this work, laser-crystallization was used to locally pattern and transform hundreds of regions of amorphous MoS2 thin films into 2D 2H-MoS2. A high throughput Raman spectroscopy approach was subsequently used to assess the process-dependent structural and compositional variations for each illuminated region, yielding over 5500 distinct non-resonant, resonant, and polarized Raman spectra. The rapid generation of a comprehensive library of structural and compositional data elucidated important trends between structure-property-processing relationships involving laser-crystallized MoS2, including the relationships between grain size, grain orientation, and intrinsic strain. Moreover, extensive analysis of structure/property relationships allowed for intelligent design, and evaluation of major contributions to, device performance in MoS2 chemical sensors. In particular, it is found that sensor performance is strongly dependent on the orientation of the MoS2 grains relative to the crystal plane.


title: Stock2Vec: An Embedding to Improve Predictive Models for Companies

abstract: Building predictive models for companies often relies on inference using historical data of companies in the same industry sector. However, companies are similar across a variety of dimensions that should be leveraged in relevant prediction problems. This is particularly true for large, complex organizations which may not be well defined by a single industry and have no clear peers. To enable prediction using company information across a variety of dimensions, we create an embedding of company stocks, Stock2Vec, which can be easily added to any prediction model that applies to companies with associated stock prices. We describe the process of creating this rich vector representation from stock price fluctuations, and characterize what the dimensions represent. We then conduct comprehensive experiments to evaluate this embedding in applied machine learning problems in various business contexts. Our experiment results demonstrate that the four features in the Stock2Vec embedding can readily augment existing cross-company models and enhance cross-company predictions.


title: A Survey of PPG's Application in Authentication

abstract: Biometric authentication prospered because of its convenient use and security. Early generations of biometric mechanisms suffer from spoofing attacks. Recently, unobservable physiological signals (e.g., Electroencephalogram, Photoplethysmogram, Electrocardiogram) as biometrics offer a potential remedy to this problem. In particular, Photoplethysmogram (PPG) measures the change in blood flow of the human body by an optical method. Clinically, researchers commonly use PPG signals to obtain patients' blood oxygen saturation, heart rate, and other information to assist in diagnosing heart-related diseases. Since PPG signals contain a wealth of individual cardiac information, researchers have begun to explore their potential in cyber security applications. The unique advantages (simple acquisition, difficult to steal, and live detection) of the PPG signal allow it to improve the security and usability of the authentication in various aspects. However, the research on PPG-based authentication is still in its infancy. The lack of systematization hinders new research in this field. We conduct a comprehensive study of PPG-based authentication and discuss these applications' limitations before pointing out future research directions.


title: Excavation Reinforcement Learning Using Geometric Representation

abstract: Excavation of irregular rigid objects in clutter, such as fragmented rocks and wood blocks, is very challenging due to their complex interaction dynamics and highly variable geometries. In this paper, we adopt reinforcement learning (RL) to tackle this challenge and learn policies to plan for a sequence of excavation trajectories for irregular rigid objects, given point clouds of excavation scenes. Moreover, we separately learn a compact representation of the point cloud on geometric tasks that do not require human labeling. We show that using the representation reduces training time for RL, while achieving similar asymptotic performance compare to an end-to-end RL algorithm. When using a policy trained in simulation directly on a real scene, we show that the policy trained with the representation outperforms end-to-end RL. To our best knowledge, this paper presents the first application of RL to plan a sequence of excavation trajectories of irregular rigid objects in clutter.


title: On the asymptotic support of Plancherel measures for homogeneous spaces

abstract: Let $G$ be a real linear reductive group and let $H$ be a unimodular, locally algebraic subgroup. Let $\operatorname{supp} L^2(G/H)$ be the set of irreducible unitary representations of $G$ contributing to the decomposition of $L^2(G/H)$, namely the support of the Plancherel measure. In this paper, we will relate $\operatorname{supp} L^2(G/H)$ with the image of moment map from the cotangent bundle $T^*(G/H)\to \mathfrak{g}^*$. For the homogeneous space $X=G/H$, we attach a complex Levi subgroup $L_X$ of the complexification of $G$ and we show that in some sense "most" of representations in $\operatorname{supp} L^2(G/H)$ are obtained as quantizations of coadjoint orbits $\mathcal{O}$ such that $\mathcal{O}\simeq G/L$ and that the complexification of $L$ is conjugate to $L_X$. Moreover, the union of such coadjoint orbits $\mathcal{O}$ coincides asymptotically with the moment map image. As a corollary, we show that $L^2(G/H)$ has a discrete series if the moment map image contains a nonempty subset of elliptic elements.


title: Highly Generalizable Models for Multilingual Hate Speech Detection

abstract: Hate speech detection has become an important research topic within the past decade. More private corporations are needing to regulate user generated content on different platforms across the globe. In this paper, we introduce a study of multilingual hate speech classification. We compile a dataset of 11 languages and resolve different taxonomies by analyzing the combined data with binary labels: hate speech or not hate speech. Defining hate speech in a single way across different languages and datasets may erase cultural nuances to the definition, therefore, we utilize language agnostic embeddings provided by LASER and MUSE in order to develop models that can use a generalized definition of hate speech across datasets. Furthermore, we evaluate prior state of the art methodologies for hate speech detection under our expanded dataset. We conduct three types of experiments for a binary hate speech classification task: Multilingual-Train Monolingual-Test, MonolingualTrain Monolingual-Test and Language-Family-Train Monolingual Test scenarios to see if performance increases for each language due to learning more from other language data.


title: Network Slicing with MEC and Deep Reinforcement Learning for the Internet of Vehicles

abstract: The interconnection of vehicles in the future fifth generation (5G) wireless ecosystem forms the so-called Internet of vehicles (IoV). IoV offers new kinds of applications requiring delay-sensitive, compute-intensive and bandwidth-hungry services. Mobile edge computing (MEC) and network slicing (NS) are two of the key enabler technologies in 5G networks that can be used to optimize the allocation of the network resources and guarantee the diverse requirements of IoV applications. As traditional model-based optimization techniques generally end up with NP-hard and strongly non-convex and non-linear mathematical programming formulations, in this paper, we introduce a model-free approach based on deep reinforcement learning (DRL) to solve the resource allocation problem in MEC-enabled IoV network based on network slicing. Furthermore, the solution uses non-orthogonal multiple access (NOMA) to enable a better exploitation of the scarce channel resources. The considered problem addresses jointly the channel and power allocation, the slice selection and the vehicles selection (vehicles grouping). We model the problem as a single-agent Markov decision process. Then, we solve it using DRL using the well-known DQL algorithm. We show that our approach is robust and effective under different network conditions compared to benchmark solutions.


title: Efficient divide-and-conquer registration of UAV and ground LiDAR point clouds through canopy shape context

abstract: Registration of unmanned aerial vehicle laser scanning (ULS) and ground light detection and ranging (LiDAR) point clouds in forests is critical to create a detailed representation of a forest structure and an accurate inversion of forest parameters. However, forest occlusion poses challenges for marker-based registration methods, and some marker-free automated registration methods have low efficiency due to the process of object (e.g., tree, crown) segmentation. Therefore, we use a divide-and-conquer strategy and propose an automated and efficient method to register ULS and ground LiDAR point clouds in forests. Registration involves coarse alignment and fine registration, where the coarse alignment of point clouds is divided into vertical and horizontal alignment. The vertical alignment is achieved by ground alignment, which is achieved by the transformation relationship between normal vectors of the ground point cloud and the horizontal plane, and the horizontal alignment is achieved by canopy projection image matching. During image matching, vegetation points are first distinguished by the ground filtering algorithm, and then, vegetation points are projected onto the horizontal plane to obtain two binary images. To match the two images, a matching strategy is used based on canopy shape context features, which are described by a two-point congruent set and canopy overlap. Finally, we implement coarse alignment of ULS and ground LiDAR datasets by combining the results of ground alignment and image matching and finish fine registration. Also, the effectiveness, accuracy, and efficiency of the proposed method are demonstrated by field measurements of forest plots. Experimental results show that the ULS and ground LiDAR data in different plots are registered, of which the horizontal alignment errors are less than 0.02 m, and the average runtime of the proposed method is less than 1 second.


title: Generation Matrix: An Embeddable Matrix Representation for Hierarchical Trees

abstract: Starting from the local structures to study hierarchical trees is a common research method. However, the cumbersome analysis and description make the naive method challenging to adapt to the increasingly complex hierarchical tree problems. To improve the efficiency of hierarchical tree research, we propose an embeddable matrix representation for hierarchical trees, called Generation Matrix. It can transform the abstract hierarchical tree into a concrete matrix representation and then take the hierarchical tree as a whole to study, which dramatically reduces the complexity of research. Mathematical analysis shows that Generation Matrix can simulate various recursive algorithms without accessing local structures and provides a variety of interpretable matrix operations to support the research of hierarchical trees. Applying Generation Matrix to differential privacy hierarchical tree release, we propose a Generation Matrix-based optimally consistent release algorithm (GMC). It provides an exceptionally concise process description so that we can describe its core steps as a simple matrix expression rather than multiple complicated recursive processes like existing algorithms. Our experiments show that GMC takes only a few seconds to complete a release for large-scale datasets with more than 10 million nodes. The calculation efficiency is increased by up to 100 times compared with the state-of-the-art schemes.


title: On Limit Measures and Their Supports for Stochastic Ordinary Differential Equations

abstract: This paper studies limit measures of stationary measures of stochastic ordinary differential equations on the Euclidean space and tries to determine which invariant measures of an unperturbed system will survive. Under the assumption for SODEs to admit the Freidlin-Wentzell or Dembo-Zeitouni large deviations principle with weaker compactness condition, we prove that limit measures are concentrated away from repellers which are topologically transitive, or equivalent classes, or admit Lebesgue measure zero. We also preclude concentrations of limit measures on acyclic saddle or trap chains. This illustrates that limit measures are concentrated on Liapunov stable compact invariant sets. Applications are made to the Morse-Smale systems, the Axiom A systems including structural stability systems and separated star systems, the gradient or gradient-like systems, those systems possessing the Poincare-Bendixson property with a finite number of limit sets to obtain that limit measures live on Liapunov stable critical elements, Liapunov stable basic sets, Liapunov stable equilibria and Liapunov stable limit sets including equilibria, limit cycles and saddle or trap cycles, respectively. A number of nontrivial examples admitting a unique limit measure are provided, which include monostable, multistable systems and those possessing infinite equivalent classes.


title: Iteratively Weighted MMSE Uplink Precoding for Cell-Free Massive MIMO

abstract: In this paper, we investigate a cell-free massive MIMO system with both access points and user equipments equipped with multiple antennas over the Weichselberger Rayleigh fading channel. We study the uplink spectral efficiency (SE) based on a two-layer decoding structure with maximum ratio (MR) or local minimum mean-square error (MMSE) combining applied in the first layer and optimal large-scale fading decoding method implemented in the second layer, respectively. To maximize the weighted sum SE, an uplink precoding structure based on an Iteratively Weighted sum-MMSE (I-WMMSE) algorithm using only channel statistics is proposed. Furthermore, with MR combining applied in the first layer, we derive novel achievable SE expressions and optimal precoding structures in closed-form. Numerical results validate our proposed results and show that the I-WMMSE precoding can achieve excellent sum SE performance.


title: Geo-MOEA: A Multi-Objective Evolutionary Algorithm with Geo-obfuscation for Mobile Crowdsourcing Workers

abstract: The rapid development of mobile Internet and sharing economy brings the prosperity of Spatial Crowdsourcing (SC). SC applications assign various tasks according to reported location information of task's requesters and outsourced workers (such as DiDi, MeiTuan and Uber). However, SC-servers are often untrustworthy and the exposure of users' locations raises privacy concerns. In this paper, we design a framework called Geo-MOEA (Multi-Objective Evolutionary Algorithm with Geo-obfuscation) to protect location privacy of workers involved on SC platform in mobile networks environment. We propose an adaptive regionalized obfuscation approach with inference error bounds based on geo-indistinguishability (a strong notion of differential privacy), which is suitable for the context of large-scale location data and task allocations. This enables each worker to report a pseudo-location that is adaptively generated with a personalized inference error threshold. Moreover, as a popular computational intelligence method, MOEA is introduced to optimize the trade-off between SC service availability and privacy protection while ensuring theoretically the most general condition on protection location sets for larger search space. Finally, the experimental results on two public datasets show that our Geo-MOEA approach achieves up to 20% reduction in service quality loss while guaranteeing differential and geo-distortion location privacy.


title: A strongly interacting photonic quantum walk using single atom beam splitters

abstract: Photonics provide an efficient way to implement quantum walks, the quantum analogue of classical random walk that demonstrates rich physics with potential applications. However, most photonic quantum walks do not involve photon interactions, which limits their potential to explore strongly-correlated many-body physics of light. We propose a strongly interacting discrete-time photonic quantum walk using a network of single atom beamsplitters. We calculate output statistics of the quantum walk for the case of two photons, which reveals the strongly-correlated transport of photons. Particularly, the walk can exhibit either boson-like or fermion-like statistics which is tunable by post-selecting the two-photon detection time interval. Also, the walk can sort different types of two-photon bound states into distinct pairs of output ports under certain conditions. These unique phenomena show that our quantum walk is an intriguing platform to explore strongly-correlated quantum many-body states of light. Finally, we propose an experimental realization based on time-multiplexed synthetic dimensions.


title: Wireless Energy Transfer in RIS-Aided Cell-Free Massive MIMO Systems: Opportunities and Challenges

abstract: In future sixth-generation (6G) mobile networks, the Internet-of-Everything (IoE) is expected to provide extremely massive connectivity for small battery-powered devices. Indeed, massive devices with limited energy storage capacity impose persistent energy demand hindering the lifetime of communication networks. As a remedy, wireless energy transfer (WET) is a key technology to address these critical energy supply issues. On the other hand, cell-free (CF) massive multiple-input multiple-output (MIMO) systems offer an efficient network architecture to realize the roll-out of the IoE. In this article, we first propose the paradigm of reconfigurable intelligent surface (RIS)-aided CF massive MIMO systems for WET, including its potential application scenarios and system architecture. The four-stage transmission procedure is discussed and analyzed to illustrate the practicality of the architecture. Then we put forward and analyze the hardware design of RIS. Particularly, we discuss the three corresponding operating modes and the amalgamation of WET technology and RIS-aided CF massive MIMO. Representative simulation results are given to confirm the superior performance achieved by our proposed schemes. Also, we investigate the optimal location of deploying multiple RISs to achieve the best system performance. Finally, several important research directions of RIS-aided CF massive MIMO systems with WET are presented to inspire further potential investigation.


title: Mutation Analysis: Answering the Fuzzing Challenge

abstract: Fuzzing is one of the fastest growing fields in software testing. The idea behind fuzzing is to check the behavior of software against a large number of randomly generated inputs, trying to cover all interesting parts of the input space, while observing the tested software for anomalous behaviour. One of the biggest challenges facing fuzzer users is how to validate software behavior, and how to improve the quality of oracles used. While mutation analysis is the premier technique for evaluating the quality of software test oracles, mutation score is rarely used as a metric for evaluating fuzzer quality. Unless mutation analysis researchers can solve multiple problems that make applying mutation analysis to fuzzing challenging, mutation analysis may be permanently sidelined in one of the most important areas of testing and security research. This paper attempts to understand the main challenges in applying mutation analysis for evaluating fuzzers, so that researchers can focus on solving these challenges.


title: Standard errors for two-way clustering with serially correlated time effects

abstract: We propose improved standard errors and an asymptotic distribution theory for two-way clustered panels. Our proposed estimator and theory allow for arbitrary serial dependence in the common time effects, which is excluded by existing two-way methods, including the popular two-way cluster standard errors of Cameron, Gelbach, and Miller (2011) and the cluster bootstrap of Menzel (2021). Our asymptotic distribution theory is the first which allows for this level of inter-dependence among the observations. Under weak regularity conditions, we demonstrate that the least squares estimator is asymptotically normal, our proposed variance estimator is consistent, and t-ratios are asymptotically standard normal, permitting conventional inference. We present simulation evidence that confidence intervals constructed with our proposed standard errors obtain superior coverage performance relative to existing methods. We illustrate the relevance of the proposed method in an empirical application to a standard Fama-French three-factor regression.


title: The Quadratic Wasserstein Metric With Squaring Scaling For Seismic Velocity Inversion

abstract: The quadratic Wasserstein metric has shown its power in measuring the difference between probability densities, which benefits optimization objective function with better convexity and is insensitive to data noise. Nevertheless, it is always an important question to make the seismic signals suitable for comparison using the quadratic Wasserstein metric. The squaring scaling is worth exploring since it guarantees the convexity caused by data shift. However, as mentioned in [Commun. Inf. Syst., 2019, 19:95-145], the squaring scaling may lose uniqueness and result in more local minima to the misfit function. In our previous work [J. Comput. Phys., 2018, 373:188-209], the quadratic Wasserstein metric with squaring scaling was successfully applied to the earthquake location problem. But it only discussed the inverse problem with few degrees of freedom. In this work, we will present a more in-depth study on the combination of squaring scaling technique and the quadratic Wasserstein metric. By discarding some inapplicable data, picking seismic phases, and developing a new normalization method, we successfully invert the seismic velocity structure based on the squaring scaling technique and the quadratic Wasserstein metric. The numerical experiments suggest that this newly proposed method is an efficient approach to obtain more accurate inversion results.


title: Multi-view learning with privileged weighted twin support vector machine

abstract: Weighted twin support vector machines (WLTSVM) mines as much potential similarity information in samples as possible to improve the common short-coming of non-parallel plane classifiers. Compared with twin support vector machines (TWSVM), it reduces the time complexity by deleting the superfluous constraints using the inter-class K-Nearest Neighbor (KNN). Multi-view learning (MVL) is a newly developing direction of machine learning, which focuses on learning acquiring information from the data indicated by multiple feature sets. In this paper, we propose multi-view learning with privileged weighted twin support vector machines (MPWTSVM). It not only inherits the advantages of WLTSVM but also has its characteristics. Firstly, it enhances generalization ability by mining intra-class information from the same perspective. Secondly, it reduces the redundancy constraints with the help of inter-class information, thus improving the running speed. Most importantly, it can follow both the consensus and the complementarity principle simultaneously as a multi-view classification model. The consensus principle is realized by minimizing the coupling items of the two views in the original objective function. The complementary principle is achieved by establishing privileged information paradigms and MVL. A standard quadratic programming solver is used to solve the problem. Compared with multi-view classification models such as SVM-2K, MVTSVM, MCPK, and PSVM-2V, our model has better accuracy and classification efficiency. Experimental results on 45 binary data sets prove the effectiveness of our method.


title: Dissecting the impact of different loss functions with gradient surgery

abstract: Pair-wise loss is an approach to metric learning that learns a semantic embedding by optimizing a loss function that encourages images from the same semantic class to be mapped closer than images from different classes. The literature reports a large and growing set of variations of the pair-wise loss strategies. Here we decompose the gradient of these loss functions into components that relate to how they push the relative feature positions of the anchor-positive and anchor-negative pairs. This decomposition allows the unification of a large collection of current pair-wise loss functions. Additionally, explicitly constructing pair-wise gradient updates to separate out these effects gives insights into which have the biggest impact, and leads to a simple algorithm that beats the state of the art for image retrieval on the CAR, CUB and Stanford Online products datasets.


title: Calibration with Privacy in Peer Review

abstract: Reviewers in peer review are often miscalibrated: they may be strict, lenient, extreme, moderate, etc. A number of algorithms have previously been proposed to calibrate reviews. Such attempts of calibration can however leak sensitive information about which reviewer reviewed which paper. In this paper, we identify this problem of calibration with privacy, and provide a foundational building block to address it. Specifically, we present a theoretical study of this problem under a simplified-yet-challenging model involving two reviewers, two papers, and an MAP-computing adversary. Our main results establish the Pareto frontier of the tradeoff between privacy (preventing the adversary from inferring reviewer identity) and utility (accepting better papers), and design explicit computationally-efficient algorithms that we prove are Pareto optimal.


title: Application and research review of cemented carbide heterogeneous brazing coating additive manufacturing

abstract: As one of the important methods for surface modification of materials and life extension of key components, cemented carbide brazing coatings are widely used in agricultural machinery, oil drilling, aerospace and other fields, it has also attracted the attention of scholars in the field of surface modification at home and abroad. Based on the research reports of recent 20 years at home and abroad, the present research situation of cemented carbide brazed coating additive manufacturing technology are reviewed firstly. The research progress in preparation and performance control of cemented carbide/iron-base, cemented carbide/copper-base, cemented carbide/nickel-base, cemented carbide/silver-base heterogeneous brazing coatings are reviewed in detail. Then the practical applications of cemented carbide heterogenous brazing coatings in the fields of contact soil agricultural machinery parts life extension, aviation parts repair, surface function strengthening and so on are reviewed. In this review, the limitation of the research of cemented carbide heterogenous braze coating technology is discussed. The deficiencies in the research and development of cemented carbide heterogenous braze coating technology are summarized including cemented carbide heterogeneous additive materials and technology need to be expanded, the structure of cemented carbide heterogeneous brazing coatings need to be optimized, the mechanism of interface defects in cemented carbide heterogeneous brazing coatings need to be clarified. Finally, the future development direction of braze coating technology is prospected, too.


title: Stability of Big Solitons in a Competitive Power Nonlinear Schr\"odinger Equation

abstract: By introducing and solving two correlative constrained variational problems as well as spectrum analysis, an approach to fix soliton frequency from the prescribed mass for nonlinear Schr\"odinger equations is found, and an open problem in normalized solutions is answered. Then existence and orbital stability of big solitons depending on frequencies for nonlinear Schr\"odinger equation with competitive power nonlinearity is proved for the first time. In addition multi-solitons of the equation with different speeds are constructed by stable big solitons.


title: Towards a Secure and Reliable Federated Learning using Blockchain

abstract: Federated learning (FL) is a distributed machine learning (ML) technique that enables collaborative training in which devices perform learning using a local dataset while preserving their privacy. This technique ensures privacy, communication efficiency, and resource conservation. Despite these advantages, FL still suffers from several challenges related to reliability (i.e., unreliable participating devices in training), tractability (i.e., a large number of trained models), and anonymity. To address these issues, we propose a secure and trustworthy blockchain framework (SRB-FL) tailored to FL, which uses blockchain features to enable collaborative model training in a fully distributed and trustworthy manner. In particular, we design a secure FL based on the blockchain sharding that ensures data reliability, scalability, and trustworthiness. In addition, we introduce an incentive mechanism to improve the reliability of FL devices using subjective multi-weight logic. The results show that our proposed SRB-FL framework is efficient and scalable, making it a promising and suitable solution for federated learning.


title: A Higher-Order Semantic Dependency Parser

abstract: Higher-order features bring significant accuracy gains in semantic dependency parsing. However, modeling higher-order features with exact inference is NP-hard. Graph neural networks (GNNs) have been demonstrated to be an effective tool for solving NP-hard problems with approximate inference in many graph learning tasks. Inspired by the success of GNNs, we investigate building a higher-order semantic dependency parser by applying GNNs. Instead of explicitly extracting higher-order features from intermediate parsing graphs, GNNs aggregate higher-order information concisely by stacking multiple GNN layers. Experimental results show that our model outperforms the previous state-of-the-art parser on the SemEval 2015 Task 18 English datasets.


title: Learning Deep Semantic Model for Code Search using CodeSearchNet Corpus

abstract: Semantic code search is the task of retrieving relevant code snippet given a natural language query. Different from typical information retrieval tasks, code search requires to bridge the semantic gap between the programming language and natural language, for better describing intrinsic concepts and semantics. Recently, deep neural network for code search has been a hot research topic. Typical methods for neural code search first represent the code snippet and query text as separate embeddings, and then use vector distance (e.g. dot-product or cosine) to calculate the semantic similarity between them. There exist many different ways for aggregating the variable length of code or query tokens into a learnable embedding, including bi-encoder, cross-encoder, and poly-encoder. The goal of the query encoder and code encoder is to produce embeddings that are close with each other for a related pair of query and the corresponding desired code snippet, in which the choice and design of encoder is very significant. In this paper, we propose a novel deep semantic model which makes use of the utilities of not only the multi-modal sources, but also feature extractors such as self-attention, the aggregated vectors, combination of the intermediate representations. We apply the proposed model to tackle the CodeSearchNet challenge about semantic code search. We align cross-lingual embedding for multi-modality learning with large batches and hard example mining, and combine different learned representations for better enhancing the representation learning. Our model is trained on CodeSearchNet corpus and evaluated on the held-out data, the final model achieves 0.384 NDCG and won the first place in this benchmark. Models and code are available at https://github.com/overwindows/SemanticCodeSearch.git.


title: A partial filament eruption in three steps induced by external magnetic reconnection

abstract: We present an investigation of partial filament eruption on 2012 June 17 in the active region NOAA 11504. For the first time, we observed the vertical splitting process during the partial eruption with high resolution narrow band images at 10830 . The active filament was rooted in a small sunspot of the active region. Particularly, it underwent the partial eruption in three steps, i.e. the precursor, the first eruption, and the second eruption, while the later two were associated with a C1.0 flare and a C3.9 flare, respectively. During the precursor, slow magnetic reconnection took place between the filament and the adjoining loops that also rooted in the sunspot. The continuous reconnection not only caused the filament to split into three groups of threads vertically but also formed a new filament, which was growing and accompanied brightening took place around the site. Subsequently, the growing filament erupted together with one group splitted threads, resulted in the first eruption. At the beginning of the first eruption, a subsequent magnetic reconnection occurred between the erupting splitted threads and another ambient magnetic loop. After about three minutes, the second eruption occurred as a result of the eruption of two larger unstable filaments induced by the magnetic reconnection. The high-resolution observation provides a direct evidence that magnetic reconnection between filament and its ambient magnetic fields could induce the vertical splitting of the filament, resulting in partial eruption.


title: Minimal model program for projective morphisms between complex analytic spaces

abstract: We discuss the minimal model program for projective morphisms of complex analytic spaces. Roughly speaking, we show that the results obtained by Birkar--Cascini--Hacon--M\textsuperscript{c}Kernan hold true for projective morphisms between complex analytic spaces. We also treat some related topics.


title: Transformer Module Networks for Systematic Generalization in Visual Question Answering

abstract: Transformers achieve great performance on Visual Question Answering (VQA). However, their systematic generalization capabilities, i.e., handling novel combinations of known concepts, is unclear. We reveal that Neural Module Networks (NMNs), i.e., question-specific compositions of modules that tackle a sub-task, achieve better or similar systematic generalization performance than the conventional Transformers, even though NMNs' modules are CNN-based. In order to address this shortcoming of Transformers with respect to NMNs, in this paper we investigate whether and how modularity can bring benefits to Transformers. Namely, we introduce Transformer Module Network (TMN), a novel NMN based on compositions of Transformer modules. TMNs achieve state-of-the-art systematic generalization performance in three VQA datasets, improving more than 30% over standard Transformers for novel compositions of sub-tasks. We show that not only the module composition but also the module specialization for each sub-task are the key of such performance gain.


title: Low-Complexity Linear Diversity-Combining Detector for MIMO-OTFS

abstract: This paper presents a low complexity detector for multiple-input multiple-output (MIMO) systems based on the recently proposed orthogonal time frequency space (OTFS) modulation. In the proposed detector, the copies of the transmitted symbol-vectors received through the different diversity branches (propagation paths and receive antennas) are linearly combined using the maximum ratio combining (MRC) technique to iteratively improve the signal to interference plus noise ratio (SINR) at the output of the combiner. To alleviate the performance degradation due to spatial correlation at the receiver antennas, we present a sample-based method to estimate such correlation and find the optimized combining weights for MRC from the estimated correlation matrix. The detector performance and complexity improve over the linear minimum mean square error (LMMSE) and message passing (MP) detectors proposed in the literature for MIMO-OTFS.


title: Unmixing based PAN guided fusion network for hyperspectral imagery

abstract: The hyperspectral image (HSI) has been widely used in many applications due to its fruitful spectral information. However, the limitation of imaging sensors has reduced its spatial resolution that causes detail loss. One solution is to fuse the low spatial resolution hyperspectral image (LR-HSI) and the panchromatic image (PAN) with inverse features to get the high-resolution hyperspectral image (HR-HSI). Most of the existing fusion methods just focus on small fusion ratios like 4 or 6, which might be impractical for some large ratios' HSI and PAN image pairs. Moreover, the ill-posedness of restoring detail information in HSI with hundreds of bands from PAN image with only one band has not been solved effectively, especially under large fusion ratios. Therefore, a lightweight unmixing-based pan-guided fusion network (Pgnet) is proposed to mitigate this ill-posedness and improve the fusion performance significantly. Note that the fusion process of the proposed network is under the projected low-dimensional abundance subspace with an extremely large fusion ratio of 16. Furthermore, based on the linear and nonlinear relationships between the PAN intensity and abundance, an interpretable PAN detail inject network (PDIN) is designed to inject the PAN details into the abundance feature efficiently. Comprehensive experiments on simulated and real datasets demonstrate the superiority and generality of our method over several state-of-the-art (SOTA) methods qualitatively and quantitatively (The codes in pytorch and paddle versions and dataset could be available at https://github.com/rs-lsl/Pgnet). (This is a improved version compared with the publication in Tgrs with the modification in the deduction of the PDIN block.)


abstract: Knowledge Distillation is a technique which aims to utilize dark knowledge to compress and transfer information from a vast, well-trained neural network (teacher model) to a smaller, less capable neural network (student model) with improved inference efficiency. This approach of distilling knowledge has gained popularity as a result of the prohibitively complicated nature of such cumbersome models for deployment on edge computing devices. Generally, the teacher models used to teach smaller student models are cumbersome in nature and expensive to train. To eliminate the necessity for a cumbersome teacher model completely, we propose a simple yet effective knowledge distillation framework that we termed Dynamic Rectification Knowledge Distillation (DR-KD). Our method transforms the student into its own teacher, and if the self-teacher makes wrong predictions while distilling information, the error is rectified prior to the knowledge being distilled. Specifically, the teacher targets are dynamically tweaked by the agency of ground-truth while distilling the knowledge gained from traditional training. Our proposed DR-KD performs remarkably well in the absence of a sophisticated cumbersome teacher model and achieves comparable performance to existing state-of-the-art teacher-free knowledge distillation frameworks when implemented by a low-cost dynamic mannered teacher. Our approach is all-encompassing and can be utilized for any deep neural network training that requires categorization or object recognition. DR-KD enhances the test accuracy on Tiny ImageNet by 2.65% over prominent baseline models, which is significantly better than any other knowledge distillation approach while requiring no additional training costs.


title: Deep Recurrent Learning for Heart Sounds Segmentation based on Instantaneous Frequency Features

abstract: In this work, a novel stack of well-known technologies is presented to determine an automatic method to segment the heart sounds in a phonocardiogram (PCG). We will show a deep recurrent neural network (DRNN) capable of segmenting a PCG into its main components and a very specific way of extracting instantaneous frequency that will play an important role in the training and testing of the proposed model. More specifically, it involves a Long Short-Term Memory (LSTM) neural network accompanied by the Fourier Synchrosqueezed Transform (FSST) used to extract instantaneous time-frequency features from a PCG. The present approach was tested on heart sound signals longer than 5 seconds and shorter than 35 seconds from freely-available databases. This approach proved that, with a relatively small architecture, a small set of data, and the right features, this method achieved an almost state-of-the-art performance, showing an average sensitivity of 89.5%, an average positive predictive value of 89.3\% and an average accuracy of 91.3%.


title: Reconstruction of Muon Bundle in the JUNO Central Detector

abstract: The Jiangmen Underground Neutrino Observatory (JUNO) is a multi-purpose neutrino experiment. One of the main goals is to determine the neutrino mass ordering by precisely measuring the energy spectrum of reactor antineutrinos. For reactor antineutrino detection, cosmogenic backgrounds such as $^9$Li/$^8$He and fast neutrons induced by cosmic muons should be rejected carefully by applying muon veto cuts, which requires good muon track reconstruction. With a 20~kton liquid scintillator detector, simulation shows the proportion of muon bundles to be around 8\% in the JUNO, while its reconstruction is rarely discussed in previous experiments. According to the charge response of the PMT array, this paper proposes an efficient algorithm for muon bundle track reconstruction. This is the first reconstruction of muon bundles in a large volume liquid scintillator detector. Additionally, the algorithm shows good performance and potential in reconstruction for both single muon and double muons. The spatial resolution of single muon reconstruction is 20~cm and the angular resolution is $0.5^\circ$. As for double muon reconstruction, the spatial resolution and angular resolution could be 30~cm and $1.0^\circ$, respectively. Moreover, this paper has also discussed muon classification and veto strategy.


title: Estimates of cusp forms for certain cocompact arithmetic subgroups

abstract: In this article, we derive a sub convexity estimate of Hecke eigen cusp forms associated to certain cocompact arithmetic subgroups of SL(2,R). The main result can be considered as the holomorphic version of the estimate of Hecke eigen Maass forms, derived in a famous paper of Iwaniec and Sarnak. A stronger estimate was derived by Khayutin and Steiner in arXiv:2009.07194. However, techniques used in both the papers are very different.


title: Gravitational Waves in Metastable Supersymmetry Breaking

abstract: If supersymmetry is broken in metastable vacua, it is not clear why we are now in there rather than supersymmetric vacua. Moreover, it is natural to expect that we were in supersymmetric vacua, which have higher symmetry than metastable vacua, in the early universe. In this paper, we reexamine and improve the previous analysis on the cosmological evolution of the vacuum structure in the ISS model of metastable supersymmetry breaking by taking into account constraints on the reheating temperature, which is needed to avoid the overproduction of gravitinos. It turns out that the desired phase transition from a supersymmetric vacuum to a metastable vacuum is allowed only in the light gravitino mass region $m_{3/2} < 4.7$ eV. This is achieved by either rolling down potential or tunneling processes depending on the reheating temperature. We show that when the tunneling processes are realized, abundant gravitational waves could be produced from collisions of runaway bubbles. The resulting gravitational waves are detectable with the future gravitational wave interferometers like LISA and DECIGO.


title: Efficient Distributed Learning in Stochastic Non-cooperative Games without Information Exchange

abstract: In this work, we study stochastic non-cooperative games, where only noisy black-box function evaluations are available to estimate the cost function for each player. Since each player's cost function depends on both its own decision variables and its rivals' decision variables, local information needs to be exchanged through a center/network in most existing work for seeking the Nash equilibrium. We propose a new stochastic distributed learning algorithm that does not require communications among players. The proposed algorithm uses simultaneous perturbation method to estimate the gradient of each cost function, and uses mirror descent method to search for the Nash equilibrium. We provide asymptotic analysis for the bias and variance of gradient estimates, and show the proposed algorithm converges to the Nash equilibrium in mean square for the class of strictly monotone games at a rate faster than the existing algorithms. The effectiveness of the proposed method is buttressed in a numerical experiment.


title: A chaotic lattice field theory in one dimension

abstract: Motivated by Gutzwiller's semiclassical quantization, in which unstable periodic orbits of low-dimensional deterministic dynamics serve as a WKB `skeleton' for chaotic quantum mechanics, we construct the corresponding deterministic skeleton for infinite-dimensional lattice-discretized scalar field theories. In the field-theoretical formulation, there is no evolution in time, and there is no `Lyapunov horizon'; there is only an enumeration of lattice states that contribute to the theory's partition sum, each a global spatiotemporal solution of system's deterministic Euler-Lagrange equations. The reformulation aligns `chaos theory' with the standard solid state, field theory, and statistical mechanics. In a spatiotemporal, crystallographer formulation, the time-periodic orbits of dynamical systems theory are replaced by periodic $d$-dimensional Bravais cell tilings of spacetime, each weighted by the inverse of its instability, its Hill determinant. Hyperbolic shadowing of large cells by smaller ones ensures that the predictions of the theory are dominated by the smallest Bravais cells. The form of the partition function of a given field theory is determined by the group of its spatiotemporal symmetries, that is, by the space group of its lattice discretization, best studied on its reciprocal lattice. Already 1-dimensional lattice discretization is of sufficient interest to be the focus of this paper. In particular, from a spatiotemporal field theory perspective, `time'-reversal is a purely crystallographic notion, a reflection point group, leading to a novel, symmetry quotienting perspective of time-reversible theories and associated topological zeta functions.


title: High-order Line Graphs of Non-uniform Hypergraphs: Algorithms, Applications, and Experimental Analysis

abstract: Hypergraphs offer flexible and robust data representations for many applications, but methods that work directly on hypergraphs are not readily available and tend to be prohibitively expensive. Much of the current analysis of hypergraphs relies on first performing a graph expansion -- either based on the nodes (clique expansion), or on the edges (line graph) -- and then running standard graph analytics on the resulting representative graph. However, this approach suffers from massive space complexity and high computational cost with increasing hypergraph size. Here, we present efficient, parallel algorithms to accelerate and reduce the memory footprint of higher-order graph expansions of hypergraphs. Our results focus on the edge-based $s$-line graph expansion, but the methods we develop work for higher-order clique expansions as well. To the best of our knowledge, ours is the first framework to enable hypergraph spectral analysis of a large dataset on a single shared-memory machine. Our methods enable the analysis of datasets from many domains that previous graph-expansion-based models are unable to provide. The proposed $s$-line graph computation algorithms are orders of magnitude faster than state-of-the-art sparse general matrix-matrix multiplication methods, and obtain approximately $5-31{\times}$ speedup over a prior state-of-the-art heuristic-based algorithm for $s$-line graph computation.


title: Aspect-Based API Review Classification: How Far Can Pre-Trained Transformer Model Go?

abstract: APIs (Application Programming Interfaces) are reusable software libraries and are building blocks for modern rapid software development. Previous research shows that programmers frequently share and search for reviews of APIs on the mainstream software question and answer (Q&A) platforms like Stack Overflow, which motivates researchers to design tasks and approaches related to process API reviews automatically. Among these tasks, classifying API reviews into different aspects (e.g., performance or security), which is called the aspect-based API review classification, is of great importance. The current state-of-the-art (SOTA) solution to this task is based on the traditional machine learning algorithm. Inspired by the great success achieved by pre-trained models on many software engineering tasks, this study fine-tunes six pre-trained models for the aspect-based API review classification task and compares them with the current SOTA solution on an API review benchmark collected by Uddin et al. The investigated models include four models (BERT, RoBERTa, ALBERT and XLNet) that are pre-trained on natural languages, BERTOverflow that is pre-trained on text corpus extracted from posts on Stack Overflow, and CosSensBERT that is designed for handling imbalanced data. The results show that all the six fine-tuned models outperform the traditional machine learning-based tool. More specifically, the improvement on the F1-score ranges from 21.0% to 30.2%. We also find that BERTOverflow, a model pre-trained on the corpus from Stack Overflow, does not show better performance than BERT. The result also suggests that CosSensBERT also does not exhibit better performance than BERT in terms of F1, but it is still worthy of being considered as it achieves better performance on MCC and AUC.


title: On the weak convergence of conditioned Bessel bridges

abstract: The purpose of this paper is to introduce the construction of a stochastic process called "$\delta$-dimensional Bessel house-moving" and its properties. We study the weak convergence of $\delta$-dimensional Bessel bridges conditioned from above, and we refer to this limit as $\delta$-dimensional Bessel house-moving. Applying this weak convergence result, we give the decomposition formula for its distribution and the Radon-Nikodym density for the distribution of the Bessel house-moving with respect to the one of the Bessel process. We also prove that $\delta$-dimensional Bessel house-moving is a $\delta$-dimensional Bessel process hitting a fixed point for the first time at $t=1$.


title: Block-encoding dense and full-rank kernels using hierarchical matrices: applications in quantum numerical linear algebra

abstract: Many quantum algorithms for numerical linear algebra assume black-box access to a block-encoding of the matrix of interest, which is a strong assumption when the matrix is not sparse. Kernel matrices, which arise from discretizing a kernel function $k(x,x')$, have a variety of applications in mathematics and engineering. They are generally dense and full-rank. Classically, the celebrated fast multipole method performs matrix multiplication on kernel matrices of dimension $N$ in time almost linear in $N$ by using the linear algebraic framework of hierarchical matrices. In light of this success, we propose a block-encoding scheme of the hierarchical matrix structure on a quantum computer. When applied to many physical kernel matrices, our method can improve the runtime of solving quantum linear systems of dimension $N$ to $O(\kappa \operatorname{polylog}(\frac{N}{\varepsilon}))$, where $\kappa$ and $\varepsilon$ are the condition number and error bound of the matrix operation. This runtime is near-optimal and, in terms of $N$, exponentially improves over prior quantum linear systems algorithms in the case of dense and full-rank kernel matrices. We discuss possible applications of our methodology in solving integral equations and accelerating computations in N-body problems.


title: IMEXLBM 1.0: A Proxy Application based on the Lattice Boltzmann Method for solving Computational Fluid Dynamic problems on GPUs

abstract: The US Department of Energy launched the Exascale Computing Project (ECP) in 2016 as part of a coordinated effort to achieve the next generation of high-performance computing (HPC) and to accelerate scientific discovery. The Exascale Proxy Applications Project began within the ECP to: (1) improve the quality of proxies created by the ECP (2) provide small, simplified codes which share important features of large applications and (3) capture programming methods and styles that drive requirements for compilers and other elements of the tool chain. This article describes one Proxy Application (or "proxy app") suite called IMEXLBM which is an open-source, self-contained code unit, with minimal dependencies, that is capable of running on heterogeneous platforms like those with graphic processing units (GPU) for accelerating the calculation. In particular, we demonstrate functionality by solving a benchmark problem in computational fluid dynamics (CFD) on the ThetaGPU machine at the Argonne Leadership Computing Facility (ALCF). Our method makes use of a domain-decomposition technique in conjunction with the message-passing interface (MPI) standard for distributed memory systems. The OpenMP application programming interface (API) is employed for shared-memory multi-processing and offloading critical kernels to the device (i.e. GPU). We also verify our effort by comparing data generated via CPU-only calculations with data generated with CPU+GPU calculations. While we demonstrate efficacy for single-phase fluid problems, the code-unit is designed to be versatile and enable new physical models that can capture complex phenomena such as two-phase flow with interface capture.


title: Epistemic AI platform accelerates innovation by connecting biomedical knowledge

abstract: Epistemic AI accelerates biomedical discovery by finding hidden connections in the network of biomedical knowledge. The Epistemic AI web-based software platform embodies the concept of knowledge mapping, an interactive process that relies on a knowledge graph in combination with natural language processing (NLP), information retrieval, relevance feedback, and network analysis. Knowledge mapping reduces information overload, prevents costly mistakes, and minimizes missed opportunities in the research process. The platform combines state-of-the-art methods for information extraction with machine learning, artificial intelligence and network analysis. Starting from a single biological entity, such as a gene or disease, users may: a) construct a map of connections to that entity, b) map an entire domain of interest, and c) gain insight into large biological networks of knowledge. Knowledge maps provide clarity and organization, simplifying the day-to-day research processes.


title: Ontology-enhanced Prompt-tuning for Few-shot Learning

abstract: Few-shot Learning (FSL) is aimed to make predictions based on a limited number of samples. Structured data such as knowledge graphs and ontology libraries has been leveraged to benefit the few-shot setting in various tasks. However, the priors adopted by the existing methods suffer from challenging knowledge missing, knowledge noise, and knowledge heterogeneity, which hinder the performance for few-shot learning. In this study, we explore knowledge injection for FSL with pre-trained language models and propose ontology-enhanced prompt-tuning (OntoPrompt). Specifically, we develop the ontology transformation based on the external knowledge graph to address the knowledge missing issue, which fulfills and converts structure knowledge to text. We further introduce span-sensitive knowledge injection via a visible matrix to select informative knowledge to handle the knowledge noise issue. To bridge the gap between knowledge and text, we propose a collective training algorithm to optimize representations jointly. We evaluate our proposed OntoPrompt in three tasks, including relation extraction, event extraction, and knowledge graph completion, with eight datasets. Experimental results demonstrate that our approach can obtain better few-shot performance than baselines.